-- Logs begin at Tue 2022-06-07 13:31:22 UTC, end at Tue 2022-06-07 14:37:47 UTC. -- Jun 07 14:07:05.405849 dv-cinder-836083-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 07 14:07:05.415000 dv-cinder-836083-9-smb devstack@keystone.service[80284]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 14:07:05 2022] *** Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: nodename: dv-cinder-836083-9-smb Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: machine: x86_64 Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: clock source: unix Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: pcre jit disabled Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: detected number of CPU cores: 4 Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: current working directory: / Jun 07 14:07:05.417016 dv-cinder-836083-9-smb devstack@keystone.service[80284]: detected binary path: /usr/bin/uwsgi-core Jun 07 14:07:05.417541 dv-cinder-836083-9-smb devstack@keystone.service[80284]: your processes number limit is 47680 Jun 07 14:07:05.417541 dv-cinder-836083-9-smb devstack@keystone.service[80284]: your memory page size is 4096 bytes Jun 07 14:07:05.417541 dv-cinder-836083-9-smb devstack@keystone.service[80284]: detected max file descriptor number: 2048 Jun 07 14:07:05.417541 dv-cinder-836083-9-smb devstack@keystone.service[80284]: lock engine: pthread robust mutexes Jun 07 14:07:05.417541 dv-cinder-836083-9-smb devstack@keystone.service[80284]: thunder lock: enabled Jun 07 14:07:05.417541 dv-cinder-836083-9-smb devstack@keystone.service[80284]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 07 14:07:05.417541 dv-cinder-836083-9-smb devstack@keystone.service[80284]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 14:07:05.462453 dv-cinder-836083-9-smb devstack@keystone.service[80284]: Python main interpreter initialized at 0x558fa72039c0 Jun 07 14:07:05.462453 dv-cinder-836083-9-smb devstack@keystone.service[80284]: python threads support enabled Jun 07 14:07:05.462453 dv-cinder-836083-9-smb devstack@keystone.service[80284]: your server socket listen backlog is limited to 100 connections Jun 07 14:07:05.462453 dv-cinder-836083-9-smb devstack@keystone.service[80284]: your mercy for graceful operations on workers is 90 seconds Jun 07 14:07:05.462765 dv-cinder-836083-9-smb devstack@keystone.service[80284]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 14:07:05.462871 dv-cinder-836083-9-smb devstack@keystone.service[80284]: *** Operational MODE: preforking *** Jun 07 14:07:05.463442 dv-cinder-836083-9-smb devstack@keystone.service[80284]: *** uWSGI is running in multiple interpreter mode *** Jun 07 14:07:05.463442 dv-cinder-836083-9-smb devstack@keystone.service[80284]: spawned uWSGI master process (pid: 80284) Jun 07 14:07:05.463626 dv-cinder-836083-9-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 07 14:07:05.464676 dv-cinder-836083-9-smb devstack@keystone.service[80284]: spawned uWSGI worker 1 (pid: 80292, cores: 1) Jun 07 14:07:05.464676 dv-cinder-836083-9-smb devstack@keystone.service[80284]: spawned uWSGI worker 2 (pid: 80293, cores: 1) Jun 07 14:07:05.464676 dv-cinder-836083-9-smb devstack@keystone.service[80284]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 14:07:11.092270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:07:11.092270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: from cryptography.utils import int_from_bytes Jun 07 14:07:11.093065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:07:11.093065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: from cryptography.utils import int_from_bytes Jun 07 14:07:11.094409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:07:11.094409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: from cryptography.utils import int_from_bytes Jun 07 14:07:11.094857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 14:07:11.094857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: from cryptography.utils import int_from_bytes Jun 07 14:07:11.142001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:07:11.142194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:07:11.142385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] command line args: [] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:07:11.142673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:07:11.142849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ================================================================================ {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:07:11.142940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 14:07:11.143056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 14:07:11.143141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] admin_token = **** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.143255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] command line args: [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 14:07:11.143365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] config_dir = [] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.143527 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.143616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 14:07:11.143695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] config_source = [] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.143771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ================================================================================ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 14:07:11.143872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] debug = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.143957 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] admin_token = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.144076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.144325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] config_dir = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.144393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.144451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.144575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] config_source = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.144676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.144785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] debug = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.144890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.144988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.145121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.145229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.145326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] list_limit = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.145429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.145525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] log_config_append = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.145627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.145723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.145827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] log_dir = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.145929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] log_file = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] log_config_append = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] log_dir = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146702 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] log_file = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.146981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.147059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.147176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.147262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.147449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.147541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.147693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.147826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.147906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.148030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.148113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.148186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.148311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.148394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.148526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.148606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.148764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.148855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.149003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.149125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.149239 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.149329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.149475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.149727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.149815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.149945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] publish_errors = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.150024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.150175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.150257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.150405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.150582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.150728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.150858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.150936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] publish_errors = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.151058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.151134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.151262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] standard_threads = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.151427 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.151560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.151638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.151752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.151831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.151914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] use_journal = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] use_json = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] standard_threads = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] use_stderr = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] use_syslog = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.152892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.153030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.153118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] use_journal = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.153233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] use_json = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.153311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.153410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] use_stderr = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.153495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.153579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] use_syslog = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.153733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.153812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 14:07:11.153979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.154069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.154216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.154303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.154463 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.154542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.154698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.154784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.154943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.155098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.155179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.155255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.155457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.155569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.155708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.155806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.155941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.156026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.156175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.156255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.156421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.156510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.156660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.156744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.156892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.156971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.157137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.157226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.157386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.157470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.157631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.157710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.157867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.157957 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.158120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.158205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.158375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.158459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.158624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.158719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.158864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.158943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.159090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.159170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.159319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.159430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.159578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.159658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.159814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.159893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.160060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.160149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.160818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.160899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.161048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.161127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.161277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.161432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.161514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.161586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.161753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.161833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.161984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.162064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.162218 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.162297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.162444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.162528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.162677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.162759 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.162907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.162987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.163134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.163220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.163380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.163464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.163613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.163694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.163840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.163921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.164074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.164155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.164304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.164389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.164535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.164613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.164765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.164844 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.164990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.165108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.165231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.165352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.165444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.165521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.165689 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.165768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.165916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.166002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.166153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.166249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.166386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.166466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.166615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.166684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.166940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.167121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.167245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.167434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.167574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.167700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.167837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.167962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.168089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.168213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.168337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.168461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.168597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.168745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.168878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.169011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.169138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.169273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.169398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.169531 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.169662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.169787 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.169918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.170968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.171955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.172985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.173145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.173227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.173387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.173468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.173625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.173705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.173861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.173941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.174096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.174176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.174328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.174407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.174562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.174643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.174795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.174876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.175025 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.175105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.175255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.175393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.175510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.175593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.175744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.175832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.176533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.176617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.176779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.176860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.177011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.177091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.177243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.177323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.177478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.177560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.177710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.177789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.177956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.178036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.178194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.178279 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.178420 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] auth.external = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.178499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.178650 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.178731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.178917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.178997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.179169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.179249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.179427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] auth.password = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.179525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.179659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] auth.token = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.179749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.external = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.179889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.179970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.180126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.180205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.180371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.180460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.180599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.180681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.password = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.180844 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.180927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.token = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.181090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.181178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.181327 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.181408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.181560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] credential.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.181641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.181796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.181884 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.182039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.182125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.182284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.182365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.182518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.182608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.182758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.182839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.182989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.183069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.183249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.183362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.183526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.183620 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.183766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.183856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.184017 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.184110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.184258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.184339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.184528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.184610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.184786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.184875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.185024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.185103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.185278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.185359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.185509 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] federation.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.185599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.185745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.185826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.185988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.186076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.186230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.186323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.186459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.186540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.186703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.186785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.186937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.187100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.187176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.187249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.187430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.187516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.187684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.187776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.187918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.188051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.188156 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.188237 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.188387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.188477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.188635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.188716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.188879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.188960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.189113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.189204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.189345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.189428 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.189586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.189839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.190091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.190332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.190570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.191031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.191293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.191621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.191892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.192158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.192314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.192396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.192576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.192657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.192842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.192924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.193097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.193181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.193352 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.193433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.193609 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.193744 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.193873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.194001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.194129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.194256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.194394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.194523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.194651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.194779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.194906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.195034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.195034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.195284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.195443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.195583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.195714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.195851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.195988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.196117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.196244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.196374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.196504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.196632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.196768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.196912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.197271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.197353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.197474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.197552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.197633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.197708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.197779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.197851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.197929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.198949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.199121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.199202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.199398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.199497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.199618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.199700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.199856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.199937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.200088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.200177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.200331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.200412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.200557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.200638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.200786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.200875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.201032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.201112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.201273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.201354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.201504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.201592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.201740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.201821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.201975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.202056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.202205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.202294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.202441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.202521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.202693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.202773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.202920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.203009 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.203160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.203241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.203426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.203508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.203664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.203756 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.203897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.203977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.204131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.204245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.204367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.204461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.204601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.204683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.204837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.204956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.205068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.205154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.205311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.205393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.205548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.205629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.205788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.205872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.206027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.206108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.206267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.206347 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.206497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.206579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.206741 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.206823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.206977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.207058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.207235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.207318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.207493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.207576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.207727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.207819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.207969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.208051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.208216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.208297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.208449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.208529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.208688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.208769 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.208916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.208997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.209153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.209234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.209385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.209467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.209619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.209701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.209853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.209934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.210102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.210185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.210334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.210413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.210562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.210642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.210796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.210878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.211033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.211113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] resource.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.211273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.211374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.211533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.211611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.211776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.211856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.212006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.212086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.212245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.212327 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.212475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.212555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.212720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.212801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.212955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.213037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.213194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.213275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.213424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] role.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.213504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.213668 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] role.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.213750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.213894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.213975 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.214138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.214221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.214376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.214457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.214616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.214696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.214852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] role.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.214931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.215092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.215174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] role.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.215322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.215449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.215613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.215694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.215858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.215940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.216089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.216171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.216335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.216469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.216579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.216662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.216822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.216905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.217067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.217158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.217315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.217461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.217542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.217695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.217777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.217942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.218025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.218191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.218272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.218437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.218518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.218683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.218875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.218957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.219114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.219196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.219389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.219511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.219649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.219744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.219875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.219956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.220112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.220203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.220342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.220424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.220592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.220673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.220842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.220933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.221081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.221161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.221313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.221393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.221547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.221637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.221773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.221853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.222004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] token.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.222085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.222245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.222335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.222481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.222562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.223218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.223306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.223494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.223577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.223730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.223811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.223964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.224043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] token.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.224202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.224283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.224441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.224521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.224682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.224763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.224914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.224995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.225151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.225232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.225383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.225465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.225627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.225709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.225870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.225951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.226096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.226176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.226336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.226419 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.226575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.226655 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.226813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.226894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.connection = **** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.227062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.227142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.227318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.227473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.227603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.227732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.227861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.227989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.228127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.228256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.228385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.228514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.228662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.228801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.228931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.229068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.229197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.229332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.229462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.229590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.229718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.229854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.229983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.230113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.230240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.230369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.230507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.230643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.230773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.230901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.231029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.231156 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.231302 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.231524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.231657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.231657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:07:11.231903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.231903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.231903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.231903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.232394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.232394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.232636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 14:07:11.232636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 14:07:11.260017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.260246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.260477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.260700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.260939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.261170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.268769 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.269537 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.296802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.297033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.297700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.297938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.350414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.351006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.398268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.398502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.399812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.400052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.464705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.464929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.465142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.465348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.465504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.465634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.465762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.465891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.466019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.466019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.466279 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.466433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.489168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.489381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.489534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.489671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.489805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.489939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.490073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.490216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.490363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.490496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.490627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.490770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.490904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.490904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.501667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.502049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.514445 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.514665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.514814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.514949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.515081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.515213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.515368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.515512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.515644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.515772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.515899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.516033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80292) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.516169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.516169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 07 14:07:11.533432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.533640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 14:07:11.533971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.534173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.534303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 14:07:11.534431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 14:07:11.534558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.534684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.534809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.534943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 07 14:07:11.535087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.535312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.535955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.536086 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.536229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.536466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.546503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.546779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.547046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.547297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.547506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.547637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.547855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.548301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.555607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.556484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.558839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.559111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.559404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.559681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.559811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.559956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.560090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.560214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.560375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.560477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.560659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.560742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.560943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.561024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.561203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.561293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.561471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.561585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.561743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.562013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.562285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.562652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.588544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.589879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.590130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.590405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.591517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.591799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.595770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.596048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.596324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.597217 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.597498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.598326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.604139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.604378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.605739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.606019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.608817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.609102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.609376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.609648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.609914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.610179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.610532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.610617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.610801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.610891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.611085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.611392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.611672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.611946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.612325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.612594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.629467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.629737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.631367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.631652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.634364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.636406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.638002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.638291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.640094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.640389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.643257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.645928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.647384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.649567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.650971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.651265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.651569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.651846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.652125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.652520 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.653242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.653540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.653824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.654109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.654388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.654792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.671911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.672188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.672451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.672710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.674332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.674618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.674886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.675148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.682042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.683858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.684131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.684577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.686404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.686681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.687164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.687464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.687738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.688020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.688299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.689758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.690039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.690323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.690615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.690902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.701888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.702169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.702442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.702714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.702989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.703258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.703562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.704666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.704946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.705225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.705506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.705785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.706062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.706347 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.721740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.725377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.725644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.728808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.728958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.730538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.732174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.732276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.732465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.732743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.733777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.735444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.735724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.736016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.740090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.741806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.743415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.745038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.745124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.745320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.745597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.745867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.748388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.748682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.748963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.749241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.755059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.755354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.755651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.758363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.758655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.758938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.763615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80292) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.763887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.764163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.764439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.764707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.764981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.765254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.765525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.765792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.766065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.766328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.766594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.766862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.766978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 07 14:07:11.767115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80292) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.767260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.767565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.767841 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.768115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.768386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.768656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.768928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.769199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.769477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.770268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.770548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.770821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.771079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 07 14:07:11.805764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558fa72039c0 pid: 80292 (default app) Jun 07 14:07:11.808972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d0689-212d-49e6-ae47-b8defe94916f None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:11.809263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d0689-212d-49e6-ae47-b8defe94916f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:11.809405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558fa72039c0 pid: 80293 (default app) Jun 07 14:07:11.809539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d0689-212d-49e6-ae47-b8defe94916f None None] PATH_INFO: `/v3` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:11.813812 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Tue Jun 7 14:07:11 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:19.814831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbc8ca-f274-4b6b-a8ba-11dcff01f133 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:19.815377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbc8ca-f274-4b6b-a8ba-11dcff01f133 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:19.815377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbc8ca-f274-4b6b-a8ba-11dcff01f133 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:19.819747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:07:19.825336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:19.825721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:19.825886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:19.892819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: INFO dbcounter [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] Registered counter for database keystone Jun 07 14:07:19.914554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG oslo_db.sqlalchemy.engines [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:07:19.920877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writer thread running {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:07:20.201610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG passlib.handlers.bcrypt [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80292) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 07 14:07:20.202037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG passlib.handlers.bcrypt [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80292) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 07 14:07:20.257296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:20.258891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:20.381243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 557 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 07 14:07:20.549323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbc8ca-f274-4b6b-a8ba-11dcff01f133 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:20.618151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: INFO dbcounter [None req-8afbc8ca-f274-4b6b-a8ba-11dcff01f133 None None] Registered counter for database keystone Jun 07 14:07:20.636974 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG oslo_db.sqlalchemy.engines [None req-8afbc8ca-f274-4b6b-a8ba-11dcff01f133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 14:07:20.643049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writer thread running {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 14:07:20.863195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbc8ca-f274-4b6b-a8ba-11dcff01f133 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:20.867725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752e20b-872b-4787-b61f-2f6dc0b23997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:20.868401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752e20b-872b-4787-b61f-2f6dc0b23997 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:20.868684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752e20b-872b-4787-b61f-2f6dc0b23997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:20.868960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752e20b-872b-4787-b61f-2f6dc0b23997 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:20.877192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752e20b-872b-4787-b61f-2f6dc0b23997 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:20.928247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2752e20b-872b-4787-b61f-2f6dc0b23997 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 07 14:07:20.928585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752e20b-872b-4787-b61f-2f6dc0b23997 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:20.937978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Tue Jun 7 14:07:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:07:20.944601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:20.959644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e4af-170f-48d2-ad63-1eaf09d1f085 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:20.964101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dafe2-bb4c-4c01-b123-32fba379bdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:20.965232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dafe2-bb4c-4c01-b123-32fba379bdba admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:20.965521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dafe2-bb4c-4c01-b123-32fba379bdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:20.965797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dafe2-bb4c-4c01-b123-32fba379bdba admin admin] PATH_INFO: `/v3/projects/4a7d532589ce43f88947a3878f92cba0` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:20.967304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dafe2-bb4c-4c01-b123-32fba379bdba admin admin] RBAC: Authorizing `identity:get_project(project_id=4a7d532589ce43f88947a3878f92cba0)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:21.017038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fc2dafe2-bb4c-4c01-b123-32fba379bdba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 07 14:07:21.017381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dafe2-bb4c-4c01-b123-32fba379bdba admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:21.023737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Tue Jun 7 14:07:20 2022] GET /identity/v3/projects/4a7d532589ce43f88947a3878f92cba0 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:23.318428 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50ab1c-f271-4460-9c0b-ee6923306f87 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:23.318963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50ab1c-f271-4460-9c0b-ee6923306f87 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:23.319061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50ab1c-f271-4460-9c0b-ee6923306f87 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:23.323400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:23.328791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da4706-3ef4-4e65-88c1-a38701528db9 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:23.329196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da4706-3ef4-4e65-88c1-a38701528db9 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:23.329344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da4706-3ef4-4e65-88c1-a38701528db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:23.347744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-36da4706-3ef4-4e65-88c1-a38701528db9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:23.349786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-36da4706-3ef4-4e65-88c1-a38701528db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:23.357590 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 07 14:07:23.379853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50ab1c-f271-4460-9c0b-ee6923306f87 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:23.392031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50ab1c-f271-4460-9c0b-ee6923306f87 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:23.396330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532072d5-6b7f-4eec-b3da-707e24f1e0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:23.396961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532072d5-6b7f-4eec-b3da-707e24f1e0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:23.397246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532072d5-6b7f-4eec-b3da-707e24f1e0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:23.397524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532072d5-6b7f-4eec-b3da-707e24f1e0cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:23.405198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532072d5-6b7f-4eec-b3da-707e24f1e0cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:23.407006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532072d5-6b7f-4eec-b3da-707e24f1e0cc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:23.416429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Tue Jun 7 14:07:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:07:23.421630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da4706-3ef4-4e65-88c1-a38701528db9 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:23.431000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da4706-3ef4-4e65-88c1-a38701528db9 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:23.435308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5285a19-6165-4e4c-a0ed-a9a39d68c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:23.436186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5285a19-6165-4e4c-a0ed-a9a39d68c15a admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:23.436468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5285a19-6165-4e4c-a0ed-a9a39d68c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:23.436740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5285a19-6165-4e4c-a0ed-a9a39d68c15a admin admin] PATH_INFO: `/v3/users/6dac917bcc034de386b578ee9ad980f6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:23.438111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5285a19-6165-4e4c-a0ed-a9a39d68c15a admin admin] RBAC: Authorizing `identity:get_user(user_id=6dac917bcc034de386b578ee9ad980f6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:23.439946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5285a19-6165-4e4c-a0ed-a9a39d68c15a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:23.441485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Tue Jun 7 14:07:23 2022] GET /identity/v3/users/6dac917bcc034de386b578ee9ad980f6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:25.730874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb4394-7db3-42ac-920e-613f2d4a80a9 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:25.731399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb4394-7db3-42ac-920e-613f2d4a80a9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:25.731499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb4394-7db3-42ac-920e-613f2d4a80a9 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:25.732810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:07:25.737867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33c80a-f763-4f5c-b518-a7028240070e None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:25.738298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33c80a-f763-4f5c-b518-a7028240070e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:25.738421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33c80a-f763-4f5c-b518-a7028240070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:25.754961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8d33c80a-f763-4f5c-b518-a7028240070e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:25.756087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8d33c80a-f763-4f5c-b518-a7028240070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:25.791569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b6140-5de6-42ca-9515-b4ddc36af1d2 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:25.791946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b6140-5de6-42ca-9515-b4ddc36af1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:25.792293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b6140-5de6-42ca-9515-b4ddc36af1d2 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:25.793693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:07:25.798897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e770e-2c03-4d54-ac66-9bf3f6700034 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:25.799189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e770e-2c03-4d54-ac66-9bf3f6700034 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:25.799501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e770e-2c03-4d54-ac66-9bf3f6700034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:25.835642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:25.840311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG passlib.handlers.bcrypt [None req-0b3e770e-2c03-4d54-ac66-9bf3f6700034 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80293) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 07 14:07:25.840731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG passlib.handlers.bcrypt [None req-0b3e770e-2c03-4d54-ac66-9bf3f6700034 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80293) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 07 14:07:25.858876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33c80a-f763-4f5c-b518-a7028240070e None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:25.882182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:25.888540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0b3e770e-2c03-4d54-ac66-9bf3f6700034 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:25.890312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0b3e770e-2c03-4d54-ac66-9bf3f6700034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:25.960316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33c80a-f763-4f5c-b518-a7028240070e None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:25.988225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:07:25.995511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0930dfd-162f-4eeb-ad92-1a31f148975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:25.996322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0930dfd-162f-4eeb-ad92-1a31f148975a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:25.996610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0930dfd-162f-4eeb-ad92-1a31f148975a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:25.996890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0930dfd-162f-4eeb-ad92-1a31f148975a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:26.008804 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0930dfd-162f-4eeb-ad92-1a31f148975a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:26.010998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e770e-2c03-4d54-ac66-9bf3f6700034 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-b0930dfd-162f-4eeb-ad92-1a31f148975a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:26.019993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:26.021073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:26.021926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:07:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:07:26.028342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0930dfd-162f-4eeb-ad92-1a31f148975a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:26.110350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e770e-2c03-4d54-ac66-9bf3f6700034 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:26.110647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:26.112944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:26.130949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0930dfd-162f-4eeb-ad92-1a31f148975a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:26.147704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c28bc6-c7b2-4a2e-9209-b0f57b94baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:26.148685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28bc6-c7b2-4a2e-9209-b0f57b94baa1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:26.149042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28bc6-c7b2-4a2e-9209-b0f57b94baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:26.149391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28bc6-c7b2-4a2e-9209-b0f57b94baa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:26.164218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d365c-b2de-4edb-956c-4ea1d69af903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:26.164879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d365c-b2de-4edb-956c-4ea1d69af903 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:26.165161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d365c-b2de-4edb-956c-4ea1d69af903 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:26.165434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d365c-b2de-4edb-956c-4ea1d69af903 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:26.166177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d365c-b2de-4edb-956c-4ea1d69af903 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:26.166481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d365c-b2de-4edb-956c-4ea1d69af903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:26.167923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d365c-b2de-4edb-956c-4ea1d69af903 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:26.180255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 8/15] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:26.185765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d365c-b2de-4edb-956c-4ea1d69af903 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:26.216905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c28bc6-c7b2-4a2e-9209-b0f57b94baa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:26.218411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c28bc6-c7b2-4a2e-9209-b0f57b94baa1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:26.287812 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d365c-b2de-4edb-956c-4ea1d69af903 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:26.315443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 8/16] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:07:26.320928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c28bc6-c7b2-4a2e-9209-b0f57b94baa1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:26.322701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176061ec-054e-46e1-95cf-710470fe6d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:26.323839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:26.323958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176061ec-054e-46e1-95cf-710470fe6d4f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:26.324128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176061ec-054e-46e1-95cf-710470fe6d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:26.324405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176061ec-054e-46e1-95cf-710470fe6d4f None admin] PATH_INFO: `/v3/users/6dac917bcc034de386b578ee9ad980f6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:26.326009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176061ec-054e-46e1-95cf-710470fe6d4f None admin] RBAC: Authorizing `identity:get_user(user_id=6dac917bcc034de386b578ee9ad980f6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:26.327602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176061ec-054e-46e1-95cf-710470fe6d4f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:26.329698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 9/17] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:26 2022] GET /identity/v3/users/6dac917bcc034de386b578ee9ad980f6 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:26.334597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176061ec-054e-46e1-95cf-710470fe6d4f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:26.349690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:26.417832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c28bc6-c7b2-4a2e-9209-b0f57b94baa1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:26.435172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176061ec-054e-46e1-95cf-710470fe6d4f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:26.451166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f25c3-eca6-4f99-ab3e-9eb2c9f98997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:26.452095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f25c3-eca6-4f99-ab3e-9eb2c9f98997 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:26.452384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f25c3-eca6-4f99-ab3e-9eb2c9f98997 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:26.452663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f25c3-eca6-4f99-ab3e-9eb2c9f98997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:26.469576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049005c-16d9-44f4-9a2c-6c546d75277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:26.470361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049005c-16d9-44f4-9a2c-6c546d75277c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:26.470644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049005c-16d9-44f4-9a2c-6c546d75277c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:26.470917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049005c-16d9-44f4-9a2c-6c546d75277c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:26.471256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f25c3-eca6-4f99-ab3e-9eb2c9f98997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:26.472133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049005c-16d9-44f4-9a2c-6c546d75277c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:26.472752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f25c3-eca6-4f99-ab3e-9eb2c9f98997 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:26.474111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049005c-16d9-44f4-9a2c-6c546d75277c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:26.475973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 10/18] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:26.481548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049005c-16d9-44f4-9a2c-6c546d75277c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-053f25c3-eca6-4f99-ab3e-9eb2c9f98997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:07:26.494345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:26.495234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:26.496293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:07:26.496293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:07:26.496293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:07:26.496293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:07:26.496293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 9/19] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:07:26.501345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f25c3-eca6-4f99-ab3e-9eb2c9f98997 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:26.558041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:26.563730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:26.583643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049005c-16d9-44f4-9a2c-6c546d75277c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:26.601638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f25c3-eca6-4f99-ab3e-9eb2c9f98997 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:26.617745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139ffc4-1224-40b3-b700-5d66dbb2828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:26.618406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139ffc4-1224-40b3-b700-5d66dbb2828e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:26.618695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139ffc4-1224-40b3-b700-5d66dbb2828e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:26.618972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139ffc4-1224-40b3-b700-5d66dbb2828e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:26.619845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139ffc4-1224-40b3-b700-5d66dbb2828e None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.domain.id=default, user.id=6dac917bcc034de386b578ee9ad980f6) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:26.620160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139ffc4-1224-40b3-b700-5d66dbb2828e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:26.621611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139ffc4-1224-40b3-b700-5d66dbb2828e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:26.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 11/20] 10.222.0.77 () {56 vars in 1322 bytes} [Tue Jun 7 14:07:26 2022] GET /identity/v3/role_assignments?user.id=6dac917bcc034de386b578ee9ad980f6&scope.domain.id=default&role.id=c6577847f998435991dac5744a94d0ee => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:26.634362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c40fc6-c300-4ec4-913c-938d836b6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:26.635046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c40fc6-c300-4ec4-913c-938d836b6e88 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:26.635328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c40fc6-c300-4ec4-913c-938d836b6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:26.635629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c40fc6-c300-4ec4-913c-938d836b6e88 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:26.636384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c40fc6-c300-4ec4-913c-938d836b6e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:26.636692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c40fc6-c300-4ec4-913c-938d836b6e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:26.638115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c40fc6-c300-4ec4-913c-938d836b6e88 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:26.658396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 10/21] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:29.136861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd4bdb-8e59-4da0-ab81-be85877bff52 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:29.137399 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd4bdb-8e59-4da0-ab81-be85877bff52 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:29.137399 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd4bdb-8e59-4da0-ab81-be85877bff52 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:29.139093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 12/22] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:29.144164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca5166-dca0-4c27-8c7d-a054d1de6666 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:29.145845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca5166-dca0-4c27-8c7d-a054d1de6666 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:29.146344 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca5166-dca0-4c27-8c7d-a054d1de6666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:29.168948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-98ca5166-dca0-4c27-8c7d-a054d1de6666 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:29.171516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-98ca5166-dca0-4c27-8c7d-a054d1de6666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:29.182150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d863e3-0248-4231-8c38-1aa2df824acb None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:29.183055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d863e3-0248-4231-8c38-1aa2df824acb None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:29.183884 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d863e3-0248-4231-8c38-1aa2df824acb None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:29.186227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 13/23] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:29.190992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2633ad6-2d42-430e-b43a-864dc5a1b686 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:29.191554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2633ad6-2d42-430e-b43a-864dc5a1b686 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:29.192598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2633ad6-2d42-430e-b43a-864dc5a1b686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:29.220788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e2633ad6-2d42-430e-b43a-864dc5a1b686 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:29.224742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e2633ad6-2d42-430e-b43a-864dc5a1b686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:29.348381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 11/24] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:29.372201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 14/25] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:29.409329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca5166-dca0-4c27-8c7d-a054d1de6666 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:29.421012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2633ad6-2d42-430e-b43a-864dc5a1b686 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:29.526509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:29.586638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:29.655036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2633ad6-2d42-430e-b43a-864dc5a1b686 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:29.681408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca5166-dca0-4c27-8c7d-a054d1de6666 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:29.735079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007fe33-c2e1-48b8-8fe6-e84ad3a31ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:29.736107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007fe33-c2e1-48b8-8fe6-e84ad3a31ffa None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:29.736388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007fe33-c2e1-48b8-8fe6-e84ad3a31ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:29.736661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007fe33-c2e1-48b8-8fe6-e84ad3a31ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:29.757663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007fe33-c2e1-48b8-8fe6-e84ad3a31ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:29.759163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007fe33-c2e1-48b8-8fe6-e84ad3a31ffa None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:29.780054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a2334-3e60-488e-9235-014b5fad725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:29.780869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a2334-3e60-488e-9235-014b5fad725f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:29.781155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a2334-3e60-488e-9235-014b5fad725f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:29.781435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a2334-3e60-488e-9235-014b5fad725f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-d007fe33-c2e1-48b8-8fe6-e84ad3a31ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:07:29.787359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:29.788167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:29.788981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:07:29.788981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:07:29.788981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:07:29.788981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:29.791111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 15/26] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:29.796835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007fe33-c2e1-48b8-8fe6-e84ad3a31ffa None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:29.815936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a2334-3e60-488e-9235-014b5fad725f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-da4a2334-3e60-488e-9235-014b5fad725f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:29.826204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:29.827209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:29.828013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:07:29.830684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 12/27] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:07:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:29.836484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a2334-3e60-488e-9235-014b5fad725f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:30.025978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007fe33-c2e1-48b8-8fe6-e84ad3a31ffa None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:30.060846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a2334-3e60-488e-9235-014b5fad725f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:30.063248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:30.079714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:30.084575 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb1a74-9372-48e6-923f-6b78b2734bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:30.085489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb1a74-9372-48e6-923f-6b78b2734bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.085958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb1a74-9372-48e6-923f-6b78b2734bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.086405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb1a74-9372-48e6-923f-6b78b2734bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.087324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb1a74-9372-48e6-923f-6b78b2734bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:30.087823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb1a74-9372-48e6-923f-6b78b2734bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:30.089408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb1a74-9372-48e6-923f-6b78b2734bb6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:30.112789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2681b-2006-43c7-a01b-13fdc4bebf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:30.113490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2681b-2006-43c7-a01b-13fdc4bebf0d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.114311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2681b-2006-43c7-a01b-13fdc4bebf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.114589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2681b-2006-43c7-a01b-13fdc4bebf0d None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.115373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2681b-2006-43c7-a01b-13fdc4bebf0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:30.115702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2681b-2006-43c7-a01b-13fdc4bebf0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:30.117111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2681b-2006-43c7-a01b-13fdc4bebf0d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:30.133722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 16/28] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:30.135100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc52c3-373f-4337-bbf8-38781ffdf8f8 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.135416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc52c3-373f-4337-bbf8-38781ffdf8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.135704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc52c3-373f-4337-bbf8-38781ffdf8f8 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.136990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 17/29] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:30.144362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc52c3-373f-4337-bbf8-38781ffdf8f8 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:30.146927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 13/30] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:30.149116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc897-6728-4726-bbc5-0dcfc86b4ec3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.149938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc897-6728-4726-bbc5-0dcfc86b4ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.152521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bc897-6728-4726-bbc5-0dcfc86b4ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.178106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e65bc897-6728-4726-bbc5-0dcfc86b4ec3 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:30.179557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e65bc897-6728-4726-bbc5-0dcfc86b4ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:30.301362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 14/31] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:30.302121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bc897-6728-4726-bbc5-0dcfc86b4ec3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:30.333104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc52c3-373f-4337-bbf8-38781ffdf8f8 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:30.387380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ec911-9905-4467-8396-a5950ed7f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:30.388294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ec911-9905-4467-8396-a5950ed7f3d3 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.388876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ec911-9905-4467-8396-a5950ed7f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.389295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ec911-9905-4467-8396-a5950ed7f3d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.390695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ec911-9905-4467-8396-a5950ed7f3d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:30.392311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ec911-9905-4467-8396-a5950ed7f3d3 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:30.431946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:30.436812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bc897-6728-4726-bbc5-0dcfc86b4ec3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:30.479297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f7d21-f967-4a22-ab95-4af7ecb763d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:30.480339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f7d21-f967-4a22-ab95-4af7ecb763d6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.480626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f7d21-f967-4a22-ab95-4af7ecb763d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.480901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f7d21-f967-4a22-ab95-4af7ecb763d6 None admin] PATH_INFO: `/v3/users/6dac917bcc034de386b578ee9ad980f6` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.482481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f7d21-f967-4a22-ab95-4af7ecb763d6 None admin] RBAC: Authorizing `identity:get_user(user_id=6dac917bcc034de386b578ee9ad980f6)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:30.484106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f7d21-f967-4a22-ab95-4af7ecb763d6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:30.485760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 15/32] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:30 2022] GET /identity/v3/users/6dac917bcc034de386b578ee9ad980f6 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:30.491478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caade39f-af93-4241-84f4-79fac481c380 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.491771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caade39f-af93-4241-84f4-79fac481c380 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.492051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caade39f-af93-4241-84f4-79fac481c380 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.493348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 16/33] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:30.494047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caade39f-af93-4241-84f4-79fac481c380 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:30.553711 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 18/34] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:07:30 2022] POST /identity/v3/projects => generated 301 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:30.555024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ec911-9905-4467-8396-a5950ed7f3d3 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:30.642110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:30.662023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caade39f-af93-4241-84f4-79fac481c380 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:30.713905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b8c3e-f066-47fd-bd97-c87b56b57399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:30.714762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b8c3e-f066-47fd-bd97-c87b56b57399 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.715048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b8c3e-f066-47fd-bd97-c87b56b57399 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.715328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b8c3e-f066-47fd-bd97-c87b56b57399 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.716149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b8c3e-f066-47fd-bd97-c87b56b57399 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:30.717564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b8c3e-f066-47fd-bd97-c87b56b57399 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:30.737830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ec911-9905-4467-8396-a5950ed7f3d3 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:30.776987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d4997-f6b6-439c-ba8a-df70a35dab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:30.777803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d4997-f6b6-439c-ba8a-df70a35dab3d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.778090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d4997-f6b6-439c-ba8a-df70a35dab3d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.778376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d4997-f6b6-439c-ba8a-df70a35dab3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.779715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d4997-f6b6-439c-ba8a-df70a35dab3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:30.781312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d4997-f6b6-439c-ba8a-df70a35dab3d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:30.782999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 19/35] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:30.788881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c102-3bca-4214-9e5e-0dfaf941c6d6 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.789232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c102-3bca-4214-9e5e-0dfaf941c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.789519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c102-3bca-4214-9e5e-0dfaf941c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.808949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-dbe5c102-3bca-4214-9e5e-0dfaf941c6d6 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:30.810746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-dbe5c102-3bca-4214-9e5e-0dfaf941c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:30.843251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 17/36] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jun 7 14:07:30 2022] POST /identity/v3/roles => generated 219 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:30.844900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788bd30-ab61-44a6-8a56-562949f05bbf None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.845204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788bd30-ab61-44a6-8a56-562949f05bbf None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.845490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788bd30-ab61-44a6-8a56-562949f05bbf None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.847018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 18/37] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:30.848832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f88248-94a1-434c-87b2-4d52f1940926 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.849437 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f88248-94a1-434c-87b2-4d52f1940926 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.849913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f88248-94a1-434c-87b2-4d52f1940926 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.851690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 19/38] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:30.852653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f88248-94a1-434c-87b2-4d52f1940926 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:30.888128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 20/39] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:30.889843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79866b3e-2486-48cd-8801-980ddda8c36c None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:30.890369 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79866b3e-2486-48cd-8801-980ddda8c36c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:30.890653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79866b3e-2486-48cd-8801-980ddda8c36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:30.900124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:30.923713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-79866b3e-2486-48cd-8801-980ddda8c36c None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:30.924942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-79866b3e-2486-48cd-8801-980ddda8c36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:30.960280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:30.987904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f88248-94a1-434c-87b2-4d52f1940926 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:31.004203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 21/40] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:31.005913 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31449d-d99a-48a2-b951-5bca611c300b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:31.006213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31449d-d99a-48a2-b951-5bca611c300b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:31.006497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31449d-d99a-48a2-b951-5bca611c300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:31.024171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-ca31449d-d99a-48a2-b951-5bca611c300b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:31.025787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ca31449d-d99a-48a2-b951-5bca611c300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:31.034041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebaf85-177b-48df-841b-37b30b805460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:31.035596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebaf85-177b-48df-841b-37b30b805460 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:31.035884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebaf85-177b-48df-841b-37b30b805460 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:31.036166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebaf85-177b-48df-841b-37b30b805460 None admin] PATH_INFO: `/v3/domains/default/users/6dac917bcc034de386b578ee9ad980f6/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:31.039384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebaf85-177b-48df-841b-37b30b805460 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6dac917bcc034de386b578ee9ad980f6, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:31.041306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebaf85-177b-48df-841b-37b30b805460 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:31.058776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 20/41] 10.222.0.77 () {58 vars in 1361 bytes} [Tue Jun 7 14:07:30 2022] PUT /identity/v3/domains/default/users/6dac917bcc034de386b578ee9ad980f6/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:07:31.059744 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebaf85-177b-48df-841b-37b30b805460 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:31.121265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 22/42] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:31.127396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31449d-d99a-48a2-b951-5bca611c300b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:31.180831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:31.201256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebaf85-177b-48df-841b-37b30b805460 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:31.239971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb48d69-7427-451a-a28e-5ac2164f821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:31.240667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb48d69-7427-451a-a28e-5ac2164f821f None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:31.240958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb48d69-7427-451a-a28e-5ac2164f821f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:31.241244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb48d69-7427-451a-a28e-5ac2164f821f None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:31.241974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:31.242439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb48d69-7427-451a-a28e-5ac2164f821f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:31.243464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb48d69-7427-451a-a28e-5ac2164f821f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:31.249701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31449d-d99a-48a2-b951-5bca611c300b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:31.263458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 21/43] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jun 7 14:07:31 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:31.264404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb48d69-7427-451a-a28e-5ac2164f821f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:31.298267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e64ae8-35c9-4d36-83f8-8995d10853b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:31.299087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e64ae8-35c9-4d36-83f8-8995d10853b8 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:31.299413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e64ae8-35c9-4d36-83f8-8995d10853b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:31.299704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e64ae8-35c9-4d36-83f8-8995d10853b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:31.301487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e64ae8-35c9-4d36-83f8-8995d10853b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:31.303013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e64ae8-35c9-4d36-83f8-8995d10853b8 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:31.304962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 23/44] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:31.310526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e64ae8-35c9-4d36-83f8-8995d10853b8 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:31.406683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb48d69-7427-451a-a28e-5ac2164f821f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:31.440634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e64ae8-35c9-4d36-83f8-8995d10853b8 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:31.455837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25960dbe-2c72-40f4-b202-c85b82208a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:31.456790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25960dbe-2c72-40f4-b202-c85b82208a1c None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:31.457082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25960dbe-2c72-40f4-b202-c85b82208a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:31.457410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25960dbe-2c72-40f4-b202-c85b82208a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:31.459651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25960dbe-2c72-40f4-b202-c85b82208a1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:31.461319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25960dbe-2c72-40f4-b202-c85b82208a1c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:31.479882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 22/45] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jun 7 14:07:31 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:31.489265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440834d9-a257-4796-b586-cab5e4f3bd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:31.490351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440834d9-a257-4796-b586-cab5e4f3bd27 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:31.490798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440834d9-a257-4796-b586-cab5e4f3bd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:31.491241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440834d9-a257-4796-b586-cab5e4f3bd27 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:31.492197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440834d9-a257-4796-b586-cab5e4f3bd27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:31.493963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440834d9-a257-4796-b586-cab5e4f3bd27 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:31.529187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 24/46] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:07:31 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:33.382457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203874dc-42ae-4a1b-8b5e-7f46697ef328 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:33.382972 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203874dc-42ae-4a1b-8b5e-7f46697ef328 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:33.383056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203874dc-42ae-4a1b-8b5e-7f46697ef328 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:33.384403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 23/47] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:33.389633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c05fe-3e12-4c54-9bf5-29e8a43279ce None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:33.390044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c05fe-3e12-4c54-9bf5-29e8a43279ce None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:33.390203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c05fe-3e12-4c54-9bf5-29e8a43279ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:33.406833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-5b6c05fe-3e12-4c54-9bf5-29e8a43279ce None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:33.408079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5b6c05fe-3e12-4c54-9bf5-29e8a43279ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:33.418689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:33.474952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 25/48] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:33.498949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203874dc-42ae-4a1b-8b5e-7f46697ef328 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:33.509363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:33.603835 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203874dc-42ae-4a1b-8b5e-7f46697ef328 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:33.636788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbdbd3-fb46-4201-83b3-51051707d697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:33.637525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbdbd3-fb46-4201-83b3-51051707d697 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:33.637816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbdbd3-fb46-4201-83b3-51051707d697 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:33.638099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbdbd3-fb46-4201-83b3-51051707d697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:33.648107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbdbd3-fb46-4201-83b3-51051707d697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-35dbdbd3-fb46-4201-83b3-51051707d697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:33.655775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:33.656604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:07:33.657359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 24/49] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:33.664394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c05fe-3e12-4c54-9bf5-29e8a43279ce None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:33.761512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c05fe-3e12-4c54-9bf5-29e8a43279ce None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:33.793937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc9fe-3977-4474-8163-ea377e2e6919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:33.794605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc9fe-3977-4474-8163-ea377e2e6919 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:33.794889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc9fe-3977-4474-8163-ea377e2e6919 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:33.795166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc9fe-3977-4474-8163-ea377e2e6919 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:33.795947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc9fe-3977-4474-8163-ea377e2e6919 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:33.796252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc9fe-3977-4474-8163-ea377e2e6919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:33.797624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc9fe-3977-4474-8163-ea377e2e6919 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:33.805582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 26/50] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:33.811046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbdbd3-fb46-4201-83b3-51051707d697 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:33.836166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d881f-90ee-4e2e-b073-8c9b0df791ff None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:33.836461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d881f-90ee-4e2e-b073-8c9b0df791ff None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:33.836749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d881f-90ee-4e2e-b073-8c9b0df791ff None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:33.838283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 27/51] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:33.842871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fec1d-24e2-47de-b87f-a15225b4ee41 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:33.843166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fec1d-24e2-47de-b87f-a15225b4ee41 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:33.843483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fec1d-24e2-47de-b87f-a15225b4ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:33.860224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-9b1fec1d-24e2-47de-b87f-a15225b4ee41 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:33.861441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9b1fec1d-24e2-47de-b87f-a15225b4ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:33.863458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:33.878704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:33.914821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbdbd3-fb46-4201-83b3-51051707d697 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:33.927054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 28/52] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:07:33.947392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760790e-5f75-44d7-b266-6b617e609fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:33.948523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760790e-5f75-44d7-b266-6b617e609fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:33.948998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760790e-5f75-44d7-b266-6b617e609fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:33.949126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760790e-5f75-44d7-b266-6b617e609fa4 None admin] PATH_INFO: `/v3/users/6dac917bcc034de386b578ee9ad980f6` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:33.949903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fec1d-24e2-47de-b87f-a15225b4ee41 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:33.950280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760790e-5f75-44d7-b266-6b617e609fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=6dac917bcc034de386b578ee9ad980f6)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:33.951782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760790e-5f75-44d7-b266-6b617e609fa4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:33.953416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 25/53] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:33 2022] GET /identity/v3/users/6dac917bcc034de386b578ee9ad980f6 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:33.959294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760790e-5f75-44d7-b266-6b617e609fa4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:34.046821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fec1d-24e2-47de-b87f-a15225b4ee41 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:34.057670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760790e-5f75-44d7-b266-6b617e609fa4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:34.080464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5927f7e-da24-4fed-9030-bfbfe793afe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:34.081259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5927f7e-da24-4fed-9030-bfbfe793afe5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:34.081543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5927f7e-da24-4fed-9030-bfbfe793afe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:34.081837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5927f7e-da24-4fed-9030-bfbfe793afe5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:34.083002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5927f7e-da24-4fed-9030-bfbfe793afe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:34.084475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5927f7e-da24-4fed-9030-bfbfe793afe5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:34.086098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 29/54] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:34.091149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac899d5-1dc5-4958-8aeb-d5440ad7c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:34.091354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5927f7e-da24-4fed-9030-bfbfe793afe5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:34.091992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac899d5-1dc5-4958-8aeb-d5440ad7c188 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:34.092283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac899d5-1dc5-4958-8aeb-d5440ad7c188 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:34.092566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac899d5-1dc5-4958-8aeb-d5440ad7c188 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:34.093774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac899d5-1dc5-4958-8aeb-d5440ad7c188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:34.095207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac899d5-1dc5-4958-8aeb-d5440ad7c188 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:34.096861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 26/55] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:34.099488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:34.102388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac899d5-1dc5-4958-8aeb-d5440ad7c188 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:34.105035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:34.191108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5927f7e-da24-4fed-9030-bfbfe793afe5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:34.203325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac899d5-1dc5-4958-8aeb-d5440ad7c188 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:34.225070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d790e-c817-4ea1-845a-9b54d2b68b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:34.225735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d790e-c817-4ea1-845a-9b54d2b68b72 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:34.226021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d790e-c817-4ea1-845a-9b54d2b68b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:34.226305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d790e-c817-4ea1-845a-9b54d2b68b72 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:34.227028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d790e-c817-4ea1-845a-9b54d2b68b72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:34.228535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d790e-c817-4ea1-845a-9b54d2b68b72 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:34.236279 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289c8bc-2045-4fcf-b3cc-55fb54bc9f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:34.236944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289c8bc-2045-4fcf-b3cc-55fb54bc9f28 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:34.237240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289c8bc-2045-4fcf-b3cc-55fb54bc9f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:34.237517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289c8bc-2045-4fcf-b3cc-55fb54bc9f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:34.238367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289c8bc-2045-4fcf-b3cc-55fb54bc9f28 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.domain.id=default, user.id=6dac917bcc034de386b578ee9ad980f6) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:34.239201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289c8bc-2045-4fcf-b3cc-55fb54bc9f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:34.240741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9289c8bc-2045-4fcf-b3cc-55fb54bc9f28 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:34.249638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 27/56] 10.222.0.77 () {56 vars in 1322 bytes} [Tue Jun 7 14:07:34 2022] GET /identity/v3/role_assignments?user.id=6dac917bcc034de386b578ee9ad980f6&scope.domain.id=default&role.id=c6577847f998435991dac5744a94d0ee => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:34.259774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 30/57] 10.222.0.77 () {60 vars in 1140 bytes} [Tue Jun 7 14:07:34 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:36.539648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26cbc0-2f84-4a94-808b-fbe3fcac95d1 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:36.540071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26cbc0-2f84-4a94-808b-fbe3fcac95d1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:36.540216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26cbc0-2f84-4a94-808b-fbe3fcac95d1 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:36.541596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 28/58] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:36.546671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17980df4-1e54-449b-aa15-b323826a31f6 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:36.547087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17980df4-1e54-449b-aa15-b323826a31f6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:36.547242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17980df4-1e54-449b-aa15-b323826a31f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:36.564122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-17980df4-1e54-449b-aa15-b323826a31f6 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:36.565298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-17980df4-1e54-449b-aa15-b323826a31f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:36.617261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:36.631171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 31/59] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:36.655013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26cbc0-2f84-4a94-808b-fbe3fcac95d1 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:36.719706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:36.761859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26cbc0-2f84-4a94-808b-fbe3fcac95d1 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:36.793695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a78b8-d147-42a7-abdd-53f711c66ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:36.794482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a78b8-d147-42a7-abdd-53f711c66ebf None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:36.794770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a78b8-d147-42a7-abdd-53f711c66ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:36.795051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a78b8-d147-42a7-abdd-53f711c66ebf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:36.796257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a78b8-d147-42a7-abdd-53f711c66ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:36.797700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a78b8-d147-42a7-abdd-53f711c66ebf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:36.799293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 29/60] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:36.805222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17980df4-1e54-449b-aa15-b323826a31f6 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:36.899164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17980df4-1e54-449b-aa15-b323826a31f6 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:36.931911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264d56a-96c1-4a5f-b07c-a783a1ae9d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:36.932572 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264d56a-96c1-4a5f-b07c-a783a1ae9d74 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:36.932852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264d56a-96c1-4a5f-b07c-a783a1ae9d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:36.933136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264d56a-96c1-4a5f-b07c-a783a1ae9d74 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:36.933851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264d56a-96c1-4a5f-b07c-a783a1ae9d74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:36.935324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264d56a-96c1-4a5f-b07c-a783a1ae9d74 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:36.961209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 32/61] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:07:36 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:07:40.366970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e03e-5a6f-4dcb-840f-6db3bcc9070f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.368076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e03e-5a6f-4dcb-840f-6db3bcc9070f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.368570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e03e-5a6f-4dcb-840f-6db3bcc9070f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.370404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 30/62] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:40.375479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8dfb7-e6aa-47fe-b6de-1a577b653e7b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.376313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8dfb7-e6aa-47fe-b6de-1a577b653e7b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.376792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8dfb7-e6aa-47fe-b6de-1a577b653e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.404388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-21d8dfb7-e6aa-47fe-b6de-1a577b653e7b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:40.405989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-21d8dfb7-e6aa-47fe-b6de-1a577b653e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:40.464297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:40.511845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 33/63] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:40.542821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0586e6-e1e8-4f3a-b64b-0e3f03250a63 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.543119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0586e6-e1e8-4f3a-b64b-0e3f03250a63 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.543424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0586e6-e1e8-4f3a-b64b-0e3f03250a63 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.545000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 31/64] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:40.548806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8dfb7-e6aa-47fe-b6de-1a577b653e7b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:40.550340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2213a-3a06-4d4f-a01a-bc69aa651931 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.550870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2213a-3a06-4d4f-a01a-bc69aa651931 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.551423 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2213a-3a06-4d4f-a01a-bc69aa651931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.581618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7ea2213a-3a06-4d4f-a01a-bc69aa651931 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:40.583159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7ea2213a-3a06-4d4f-a01a-bc69aa651931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:40.671424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 32/65] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:07:40.673200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d558b71-23b0-404b-8a47-3e08d14ad49d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.673786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d558b71-23b0-404b-8a47-3e08d14ad49d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.674303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d558b71-23b0-404b-8a47-3e08d14ad49d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.675757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 33/66] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:40.681911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2bf5-8de9-404f-9fd3-f3c1f5826458 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.682202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2bf5-8de9-404f-9fd3-f3c1f5826458 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.682478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2bf5-8de9-404f-9fd3-f3c1f5826458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.692529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8dfb7-e6aa-47fe-b6de-1a577b653e7b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:40.708414 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-24fd2bf5-8de9-404f-9fd3-f3c1f5826458 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:40.710577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-24fd2bf5-8de9-404f-9fd3-f3c1f5826458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:40.733444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc0bd-ed81-462b-9719-7c1db8924f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:40.734501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc0bd-ed81-462b-9719-7c1db8924f99 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.734955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc0bd-ed81-462b-9719-7c1db8924f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.735412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbc0bd-ed81-462b-9719-7c1db8924f99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.746424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbc0bd-ed81-462b-9719-7c1db8924f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-2cdbc0bd-ed81-462b-9719-7c1db8924f99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:40.754317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:40.755173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:40.756041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:40.759115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 34/67] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:40.760160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc0bd-ed81-462b-9719-7c1db8924f99 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:40.784870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:40.796813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 34/68] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:40.803608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2bf5-8de9-404f-9fd3-f3c1f5826458 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:40.804101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:40.883419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbc0bd-ed81-462b-9719-7c1db8924f99 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:40.923673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2bf5-8de9-404f-9fd3-f3c1f5826458 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:40.923850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9109b-88de-4765-9816-d1cb5b752dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:40.924505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9109b-88de-4765-9816-d1cb5b752dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.924794 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9109b-88de-4765-9816-d1cb5b752dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.925073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9109b-88de-4765-9816-d1cb5b752dc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.936042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9109b-88de-4765-9816-d1cb5b752dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-94d9109b-88de-4765-9816-d1cb5b752dc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:40.943755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:40.944586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:40.945367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 35/69] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:40.945993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9109b-88de-4765-9816-d1cb5b752dc5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:40.961516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2847718-4ceb-4404-8666-c012f210ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:40.962193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2847718-4ceb-4404-8666-c012f210ab84 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.962478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2847718-4ceb-4404-8666-c012f210ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.962758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2847718-4ceb-4404-8666-c012f210ab84 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.963548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2847718-4ceb-4404-8666-c012f210ab84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:40.963867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2847718-4ceb-4404-8666-c012f210ab84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:40.965243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2847718-4ceb-4404-8666-c012f210ab84 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:40.973627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 35/70] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:07:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:40.975635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685780b0-b338-406b-b029-8b5ff8620b98 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:40.975929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685780b0-b338-406b-b029-8b5ff8620b98 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:40.976211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685780b0-b338-406b-b029-8b5ff8620b98 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:40.977439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 36/71] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:40.978265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685780b0-b338-406b-b029-8b5ff8620b98 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.040928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:41.055253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:41.063267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9109b-88de-4765-9816-d1cb5b752dc5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.089327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685780b0-b338-406b-b029-8b5ff8620b98 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.099114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b0c7-d3b6-43ba-9eb9-4b562b88d479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.100000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b0c7-d3b6-43ba-9eb9-4b562b88d479 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.100291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b0c7-d3b6-43ba-9eb9-4b562b88d479 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.100573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2b0c7-d3b6-43ba-9eb9-4b562b88d479 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.110829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2b0c7-d3b6-43ba-9eb9-4b562b88d479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-daf2b0c7-d3b6-43ba-9eb9-4b562b88d479 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:41.118798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:41.119659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:41.120449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 36/72] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:07:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:41.121067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b0c7-d3b6-43ba-9eb9-4b562b88d479 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.122844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee2165-7f5a-41b3-b658-338446c9983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.123550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee2165-7f5a-41b3-b658-338446c9983a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.123833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee2165-7f5a-41b3-b658-338446c9983a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.124112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee2165-7f5a-41b3-b658-338446c9983a None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.124872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee2165-7f5a-41b3-b658-338446c9983a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:41.125180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee2165-7f5a-41b3-b658-338446c9983a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:41.126542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee2165-7f5a-41b3-b658-338446c9983a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:41.135753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 37/73] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:41.136946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80beda5-2f3e-4eb8-8b3a-3661df40b659 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.137233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80beda5-2f3e-4eb8-8b3a-3661df40b659 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.137514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80beda5-2f3e-4eb8-8b3a-3661df40b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.153363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e80beda5-2f3e-4eb8-8b3a-3661df40b659 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:41.154556 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e80beda5-2f3e-4eb8-8b3a-3661df40b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:41.219657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 38/74] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:41.220876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe766d0-4c4c-4a4b-b7e9-4dcc3f4ee182 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.221177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe766d0-4c4c-4a4b-b7e9-4dcc3f4ee182 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.221460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe766d0-4c4c-4a4b-b7e9-4dcc3f4ee182 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.222728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 39/75] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:41.223454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe766d0-4c4c-4a4b-b7e9-4dcc3f4ee182 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.236292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2b0c7-d3b6-43ba-9eb9-4b562b88d479 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.270173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72e7c-020d-4272-99b6-4aa991738d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.271054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72e7c-020d-4272-99b6-4aa991738d74 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.271431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72e7c-020d-4272-99b6-4aa991738d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.271722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72e7c-020d-4272-99b6-4aa991738d74 None admin] PATH_INFO: `/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.272058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:41.284911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef72e7c-020d-4272-99b6-4aa991738d74 None admin] RBAC: Authorizing `identity:get_user(user_id=dc32afaae6ca4f2aa28cb24fd65dc652)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:41.286375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef72e7c-020d-4272-99b6-4aa991738d74 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:41.288579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 37/76] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:41 2022] GET /identity/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:41.289345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72e7c-020d-4272-99b6-4aa991738d74 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.305985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:41.327733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe766d0-4c4c-4a4b-b7e9-4dcc3f4ee182 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.364631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2f325-3866-4f5d-9ce9-46c2c2e4deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.366113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2f325-3866-4f5d-9ce9-46c2c2e4deaa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.366402 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2f325-3866-4f5d-9ce9-46c2c2e4deaa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.366685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2f325-3866-4f5d-9ce9-46c2c2e4deaa None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.367504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2f325-3866-4f5d-9ce9-46c2c2e4deaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:41.368024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2f325-3866-4f5d-9ce9-46c2c2e4deaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:41.369233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2f325-3866-4f5d-9ce9-46c2c2e4deaa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:41.378398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 40/77] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:07:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:41.384572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725b604-3305-4ddf-8104-594f254add06 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.384874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725b604-3305-4ddf-8104-594f254add06 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.385164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725b604-3305-4ddf-8104-594f254add06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.394544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72e7c-020d-4272-99b6-4aa991738d74 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.402854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0725b604-3305-4ddf-8104-594f254add06 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:41.404106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0725b604-3305-4ddf-8104-594f254add06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:41.431104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7925b4-6f09-4d87-9fb5-20167f5512ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.432036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7925b4-6f09-4d87-9fb5-20167f5512ca None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.432320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7925b4-6f09-4d87-9fb5-20167f5512ca None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.432599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7925b4-6f09-4d87-9fb5-20167f5512ca None admin] PATH_INFO: `/v3/users/6dac917bcc034de386b578ee9ad980f6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.433801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7925b4-6f09-4d87-9fb5-20167f5512ca None admin] RBAC: Authorizing `identity:get_user(user_id=6dac917bcc034de386b578ee9ad980f6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:41.435255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7925b4-6f09-4d87-9fb5-20167f5512ca None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:41.437260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 38/78] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:41 2022] GET /identity/v3/users/6dac917bcc034de386b578ee9ad980f6 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:41.438101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7925b4-6f09-4d87-9fb5-20167f5512ca None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.484501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 41/79] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:41.496266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725b604-3305-4ddf-8104-594f254add06 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.535590 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:41.545481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:41.556208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7925b4-6f09-4d87-9fb5-20167f5512ca None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.592423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9afbe5-fbea-481c-a20a-7e90922623e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.593257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9afbe5-fbea-481c-a20a-7e90922623e7 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.593549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9afbe5-fbea-481c-a20a-7e90922623e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.593832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9afbe5-fbea-481c-a20a-7e90922623e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.604707 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725b604-3305-4ddf-8104-594f254add06 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.605432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9afbe5-fbea-481c-a20a-7e90922623e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-ca9afbe5-fbea-481c-a20a-7e90922623e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:41.614918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:41.615966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:41.616764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 39/80] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:41.617885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9afbe5-fbea-481c-a20a-7e90922623e7 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.640854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b00e8-3a66-4465-bc44-43a8ff15bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.641517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b00e8-3a66-4465-bc44-43a8ff15bead None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.641803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b00e8-3a66-4465-bc44-43a8ff15bead None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.642083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b00e8-3a66-4465-bc44-43a8ff15bead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.712514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b00e8-3a66-4465-bc44-43a8ff15bead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:41.713995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b00e8-3a66-4465-bc44-43a8ff15bead None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:41.721747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9afbe5-fbea-481c-a20a-7e90922623e7 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.753728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:41.754757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6db89-765c-44d2-93f9-ccd588d9faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.755750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6db89-765c-44d2-93f9-ccd588d9faa6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.756051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6db89-765c-44d2-93f9-ccd588d9faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.756340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6db89-765c-44d2-93f9-ccd588d9faa6 None admin] PATH_INFO: `/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.757564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6db89-765c-44d2-93f9-ccd588d9faa6 None admin] RBAC: Authorizing `identity:get_user(user_id=dc32afaae6ca4f2aa28cb24fd65dc652)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:41.759023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6db89-765c-44d2-93f9-ccd588d9faa6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:41.760704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 40/81] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:41 2022] GET /identity/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:41.761471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6db89-765c-44d2-93f9-ccd588d9faa6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.772387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:41.816391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 42/82] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:41.817232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b00e8-3a66-4465-bc44-43a8ff15bead None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.863452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6db89-765c-44d2-93f9-ccd588d9faa6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.897220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d1c7e-141b-4d10-9495-8ecea31676be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.897859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1c7e-141b-4d10-9495-8ecea31676be None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.898143 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1c7e-141b-4d10-9495-8ecea31676be None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.898414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1c7e-141b-4d10-9495-8ecea31676be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.914228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b00e8-3a66-4465-bc44-43a8ff15bead None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:41.947638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3777831-257e-43ab-b68d-f192d90c2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:41.948683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3777831-257e-43ab-b68d-f192d90c2548 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:41.948977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3777831-257e-43ab-b68d-f192d90c2548 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:41.949260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3777831-257e-43ab-b68d-f192d90c2548 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:41.950445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3777831-257e-43ab-b68d-f192d90c2548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:41.951924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3777831-257e-43ab-b68d-f192d90c2548 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:41.953573 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 43/83] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:41.954345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3777831-257e-43ab-b68d-f192d90c2548 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:41.965483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d1c7e-141b-4d10-9495-8ecea31676be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:41.966496 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:41.966963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d1c7e-141b-4d10-9495-8ecea31676be None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:41.976622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:42.052537 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3777831-257e-43ab-b68d-f192d90c2548 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.065777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 41/84] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:42.066707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d1c7e-141b-4d10-9495-8ecea31676be None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.088385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067a435-1944-48db-b310-250de74866d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.089052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067a435-1944-48db-b310-250de74866d9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.089339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067a435-1944-48db-b310-250de74866d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.089622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067a435-1944-48db-b310-250de74866d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.090377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067a435-1944-48db-b310-250de74866d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:42.090695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067a435-1944-48db-b310-250de74866d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:42.092108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067a435-1944-48db-b310-250de74866d9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:42.099994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 44/85] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:07:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:42.100769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067a435-1944-48db-b310-250de74866d9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.166552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:42.170046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d1c7e-141b-4d10-9495-8ecea31676be None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.180614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:42.197183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067a435-1944-48db-b310-250de74866d9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.206330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd7c8c-36ff-431a-901b-db8b9d9c5463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.206985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd7c8c-36ff-431a-901b-db8b9d9c5463 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.207273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd7c8c-36ff-431a-901b-db8b9d9c5463 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.207582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd7c8c-36ff-431a-901b-db8b9d9c5463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.229832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3f25-d8da-4a14-9c0e-cdcb0696f5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.230691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3f25-d8da-4a14-9c0e-cdcb0696f5be None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.230972 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3f25-d8da-4a14-9c0e-cdcb0696f5be None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.231244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af3f25-d8da-4a14-9c0e-cdcb0696f5be None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.232465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3f25-d8da-4a14-9c0e-cdcb0696f5be None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:42.233894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af3f25-d8da-4a14-9c0e-cdcb0696f5be None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:42.235644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 45/86] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:42 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:42.236378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3f25-d8da-4a14-9c0e-cdcb0696f5be None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.274476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd7c8c-36ff-431a-901b-db8b9d9c5463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:42.276000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd7c8c-36ff-431a-901b-db8b9d9c5463 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:42.335912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af3f25-d8da-4a14-9c0e-cdcb0696f5be None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.368443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed63ab-c001-4b90-8e42-be0d816e9f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.369115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed63ab-c001-4b90-8e42-be0d816e9f52 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.369403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed63ab-c001-4b90-8e42-be0d816e9f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.369684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed63ab-c001-4b90-8e42-be0d816e9f52 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.370394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed63ab-c001-4b90-8e42-be0d816e9f52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:42.371876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed63ab-c001-4b90-8e42-be0d816e9f52 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:42.373224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 42/87] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:42.374059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd7c8c-36ff-431a-901b-db8b9d9c5463 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.384157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:42.391542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:42.404660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 46/88] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:07:42 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:42.405512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed63ab-c001-4b90-8e42-be0d816e9f52 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.485911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd7c8c-36ff-431a-901b-db8b9d9c5463 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.529617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a49f57-1bd8-4aeb-82f4-65192ec28d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.530650 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a49f57-1bd8-4aeb-82f4-65192ec28d8e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.530942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a49f57-1bd8-4aeb-82f4-65192ec28d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.531471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a49f57-1bd8-4aeb-82f4-65192ec28d8e None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.532766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a49f57-1bd8-4aeb-82f4-65192ec28d8e None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:42.534269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a49f57-1bd8-4aeb-82f4-65192ec28d8e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:42.536184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 43/89] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:42 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:42.537523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a49f57-1bd8-4aeb-82f4-65192ec28d8e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.537962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed63ab-c001-4b90-8e42-be0d816e9f52 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.579151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf5269-7088-4567-b89e-0e9a6d26ece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.580211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf5269-7088-4567-b89e-0e9a6d26ece6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.580631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf5269-7088-4567-b89e-0e9a6d26ece6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.580933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf5269-7088-4567-b89e-0e9a6d26ece6 None admin] PATH_INFO: `/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.582264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf5269-7088-4567-b89e-0e9a6d26ece6 None admin] RBAC: Authorizing `identity:get_user(user_id=dc32afaae6ca4f2aa28cb24fd65dc652)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:42.583826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf5269-7088-4567-b89e-0e9a6d26ece6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:42.585516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 47/90] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:42 2022] GET /identity/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:42.586383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf5269-7088-4567-b89e-0e9a6d26ece6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.637614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:42.664237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:42.665766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a49f57-1bd8-4aeb-82f4-65192ec28d8e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.712203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18930fc-40f2-461b-a19d-f4a71561270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.713164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18930fc-40f2-461b-a19d-f4a71561270c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.713443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18930fc-40f2-461b-a19d-f4a71561270c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.713728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18930fc-40f2-461b-a19d-f4a71561270c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.714734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18930fc-40f2-461b-a19d-f4a71561270c None admin] RBAC: Adding query filter params (role.id=a284a48d48b2440997815469786a10ec, scope.project.id=a91db3386fe24593821f7424072923f8, user.id=dc32afaae6ca4f2aa28cb24fd65dc652) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:42.715051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18930fc-40f2-461b-a19d-f4a71561270c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:42.717141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18930fc-40f2-461b-a19d-f4a71561270c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:42.719605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf5269-7088-4567-b89e-0e9a6d26ece6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.724961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 44/91] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:42 2022] GET /identity/v3/role_assignments?user.id=dc32afaae6ca4f2aa28cb24fd65dc652&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=a284a48d48b2440997815469786a10ec => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:42.726020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18930fc-40f2-461b-a19d-f4a71561270c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.777763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44612a-f2e1-48d3-911f-3b911828e30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.778682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44612a-f2e1-48d3-911f-3b911828e30c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.779011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44612a-f2e1-48d3-911f-3b911828e30c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.779316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44612a-f2e1-48d3-911f-3b911828e30c None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.780618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44612a-f2e1-48d3-911f-3b911828e30c None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:42.782645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44612a-f2e1-48d3-911f-3b911828e30c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:42.785190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 48/92] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:42 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:42.786440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44612a-f2e1-48d3-911f-3b911828e30c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.862365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18930fc-40f2-461b-a19d-f4a71561270c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.924317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44612a-f2e1-48d3-911f-3b911828e30c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:42.948887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdd374-7e7a-41cf-991b-6f9256e4eb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.949569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdd374-7e7a-41cf-991b-6f9256e4eb8a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.949854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdd374-7e7a-41cf-991b-6f9256e4eb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.950132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdd374-7e7a-41cf-991b-6f9256e4eb8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.950986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdd374-7e7a-41cf-991b-6f9256e4eb8a None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=a91db3386fe24593821f7424072923f8, user.id=6dac917bcc034de386b578ee9ad980f6) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:42.951299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdd374-7e7a-41cf-991b-6f9256e4eb8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:42.953431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdd374-7e7a-41cf-991b-6f9256e4eb8a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:42.960803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:42.966378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86934174-2a56-4897-9b32-e1eea15ea995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:42.966524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 45/93] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:42 2022] GET /identity/v3/role_assignments?user.id=6dac917bcc034de386b578ee9ad980f6&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=c6577847f998435991dac5744a94d0ee => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:42.966830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86934174-2a56-4897-9b32-e1eea15ea995 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:42.968525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdd374-7e7a-41cf-991b-6f9256e4eb8a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:42.968634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86934174-2a56-4897-9b32-e1eea15ea995 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:42.968634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86934174-2a56-4897-9b32-e1eea15ea995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:42.977610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:43.052768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86934174-2a56-4897-9b32-e1eea15ea995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:43.054290 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86934174-2a56-4897-9b32-e1eea15ea995 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:43.225501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 49/94] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:43.231076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86934174-2a56-4897-9b32-e1eea15ea995 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:43.275671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:43.298371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdd374-7e7a-41cf-991b-6f9256e4eb8a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:43.352258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86934174-2a56-4897-9b32-e1eea15ea995 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:43.387658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff65bc-6ec9-4ee7-b8d7-fa31af028439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:43.388549 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff65bc-6ec9-4ee7-b8d7-fa31af028439 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:43.388844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff65bc-6ec9-4ee7-b8d7-fa31af028439 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:43.389134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff65bc-6ec9-4ee7-b8d7-fa31af028439 None admin] PATH_INFO: `/v3/projects/f9432f44630344dd8d60b047a9b895bd` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:43.390370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff65bc-6ec9-4ee7-b8d7-fa31af028439 None admin] RBAC: Authorizing `identity:get_project(project_id=f9432f44630344dd8d60b047a9b895bd)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:43.391974 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff65bc-6ec9-4ee7-b8d7-fa31af028439 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:43.394026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 50/95] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:43 2022] GET /identity/v3/projects/f9432f44630344dd8d60b047a9b895bd => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:43.400063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff65bc-6ec9-4ee7-b8d7-fa31af028439 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:43.432147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5729-276f-4746-a721-67396ca7a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:43.432835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5729-276f-4746-a721-67396ca7a62a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:43.433125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5729-276f-4746-a721-67396ca7a62a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:43.433402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5729-276f-4746-a721-67396ca7a62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:43.434251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde5729-276f-4746-a721-67396ca7a62a None admin] RBAC: Adding query filter params (role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=a91db3386fe24593821f7424072923f8, user.id=dc32afaae6ca4f2aa28cb24fd65dc652) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:43.434563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde5729-276f-4746-a721-67396ca7a62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:43.436056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde5729-276f-4746-a721-67396ca7a62a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:43.457119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 46/96] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:42 2022] GET /identity/v3/role_assignments?user.id=dc32afaae6ca4f2aa28cb24fd65dc652&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 259 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:43.519116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff65bc-6ec9-4ee7-b8d7-fa31af028439 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:43.530957 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:43.558692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee8561-fdcd-485a-9a58-93f2c82b1254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:43.559428 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee8561-fdcd-485a-9a58-93f2c82b1254 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:43.559722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee8561-fdcd-485a-9a58-93f2c82b1254 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:43.560200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee8561-fdcd-485a-9a58-93f2c82b1254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:43.561079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee8561-fdcd-485a-9a58-93f2c82b1254 None admin] RBAC: Adding query filter params (role.id=a284a48d48b2440997815469786a10ec, scope.project.id=f9432f44630344dd8d60b047a9b895bd, user.id=dc32afaae6ca4f2aa28cb24fd65dc652) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:43.561661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee8561-fdcd-485a-9a58-93f2c82b1254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:43.563226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee8561-fdcd-485a-9a58-93f2c82b1254 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:43.570457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 51/97] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:43 2022] GET /identity/v3/role_assignments?user.id=dc32afaae6ca4f2aa28cb24fd65dc652&scope.project.id=f9432f44630344dd8d60b047a9b895bd&role.id=a284a48d48b2440997815469786a10ec => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:45.385661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478eea6f-e75d-463a-b7ed-0eb8886cc861 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:45.386203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478eea6f-e75d-463a-b7ed-0eb8886cc861 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:45.386203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478eea6f-e75d-463a-b7ed-0eb8886cc861 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:45.387617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 47/98] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:45.393141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad05b-707e-4856-bb5a-e617d229ca1a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:45.393974 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad05b-707e-4856-bb5a-e617d229ca1a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:45.394475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ad05b-707e-4856-bb5a-e617d229ca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:45.412706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a76ad05b-707e-4856-bb5a-e617d229ca1a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:45.414250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a76ad05b-707e-4856-bb5a-e617d229ca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:45.495850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 52/99] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:45.519330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478eea6f-e75d-463a-b7ed-0eb8886cc861 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:45.601073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3f52b-6a84-4c82-a124-9951a11212fd None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:45.601720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3f52b-6a84-4c82-a124-9951a11212fd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:45.602223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3f52b-6a84-4c82-a124-9951a11212fd None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:45.603843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 53/100] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:07:45.607699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:45.608985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22bcb2-aee1-4bed-9863-8c14d49f8306 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:45.609274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22bcb2-aee1-4bed-9863-8c14d49f8306 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:45.609561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22bcb2-aee1-4bed-9863-8c14d49f8306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:45.627533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ba22bcb2-aee1-4bed-9863-8c14d49f8306 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:45.629574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ba22bcb2-aee1-4bed-9863-8c14d49f8306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:45.676113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478eea6f-e75d-463a-b7ed-0eb8886cc861 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:45.706304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 54/101] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:45.727516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1cec6-21a5-4463-a9bb-a1a735835db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:45.728664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1cec6-21a5-4463-a9bb-a1a735835db2 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:45.729164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1cec6-21a5-4463-a9bb-a1a735835db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:45.729651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1cec6-21a5-4463-a9bb-a1a735835db2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:45.741351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22bcb2-aee1-4bed-9863-8c14d49f8306 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:45.744052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1cec6-21a5-4463-a9bb-a1a735835db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-3cd1cec6-21a5-4463-a9bb-a1a735835db2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:45.752111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:45.753013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:45.753826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 48/102] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:45.774271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1cec6-21a5-4463-a9bb-a1a735835db2 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:45.795761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:45.858564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22bcb2-aee1-4bed-9863-8c14d49f8306 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:45.894099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7c15-bc08-41a3-ba97-759f81fa1c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:45.895254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7c15-bc08-41a3-ba97-759f81fa1c18 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:45.895786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7c15-bc08-41a3-ba97-759f81fa1c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:45.896866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7c15-bc08-41a3-ba97-759f81fa1c18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:45.898282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb7c15-bc08-41a3-ba97-759f81fa1c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:45.900027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb7c15-bc08-41a3-ba97-759f81fa1c18 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:45.901879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 55/103] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:45.912350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7c15-bc08-41a3-ba97-759f81fa1c18 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:46.025645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1cec6-21a5-4463-a9bb-a1a735835db2 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:46.092948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:46.104867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049cbb0-8b87-457b-ae75-2af6e5be6dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:46.105561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049cbb0-8b87-457b-ae75-2af6e5be6dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:46.105852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049cbb0-8b87-457b-ae75-2af6e5be6dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:46.106149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049cbb0-8b87-457b-ae75-2af6e5be6dd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:46.106920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049cbb0-8b87-457b-ae75-2af6e5be6dd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:46.107236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049cbb0-8b87-457b-ae75-2af6e5be6dd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:46.108658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049cbb0-8b87-457b-ae75-2af6e5be6dd4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:46.123731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:46.127535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 49/104] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:07:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:46.140239 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7c15-bc08-41a3-ba97-759f81fa1c18 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:46.145213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049cbb0-8b87-457b-ae75-2af6e5be6dd4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:46.179308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a335b2-09dc-4f7b-9729-f73e327be803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:46.180447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a335b2-09dc-4f7b-9729-f73e327be803 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:46.180903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a335b2-09dc-4f7b-9729-f73e327be803 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:46.181340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a335b2-09dc-4f7b-9729-f73e327be803 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:46.182203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a335b2-09dc-4f7b-9729-f73e327be803 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:46.183963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a335b2-09dc-4f7b-9729-f73e327be803 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:46.243045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 56/105] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:07:45 2022] POST /identity/v3/projects => generated 302 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:46.321039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049cbb0-8b87-457b-ae75-2af6e5be6dd4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:46.363869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34e311-2e63-422c-90de-6ae01541f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:46.365723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34e311-2e63-422c-90de-6ae01541f770 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:46.366210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34e311-2e63-422c-90de-6ae01541f770 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:46.366712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34e311-2e63-422c-90de-6ae01541f770 None admin] PATH_INFO: `/v3/users/45cfbef997ac416e9a5450add3404a63` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:46.385939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34e311-2e63-422c-90de-6ae01541f770 None admin] RBAC: Authorizing `identity:get_user(user_id=45cfbef997ac416e9a5450add3404a63)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:46.387475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34e311-2e63-422c-90de-6ae01541f770 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:46.389397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 50/106] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:46 2022] GET /identity/v3/users/45cfbef997ac416e9a5450add3404a63 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:46.396629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a335b2-09dc-4f7b-9729-f73e327be803 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:46.564996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded35c8b-3e02-415c-b57e-dc8fe9e8a894 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:46.565288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded35c8b-3e02-415c-b57e-dc8fe9e8a894 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:46.565824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded35c8b-3e02-415c-b57e-dc8fe9e8a894 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:46.567724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 51/107] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:46.574298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc3a81-0223-433d-b2a3-5c840cf709c8 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:46.574871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc3a81-0223-433d-b2a3-5c840cf709c8 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:46.575504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc3a81-0223-433d-b2a3-5c840cf709c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:46.577805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a335b2-09dc-4f7b-9729-f73e327be803 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:46.607865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-70fc3a81-0223-433d-b2a3-5c840cf709c8 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:46.611108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-70fc3a81-0223-433d-b2a3-5c840cf709c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:46.642891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7edf9-a43d-4192-8b30-978f2f6cf3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:46.643586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7edf9-a43d-4192-8b30-978f2f6cf3da None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:46.643872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7edf9-a43d-4192-8b30-978f2f6cf3da None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:46.644152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7edf9-a43d-4192-8b30-978f2f6cf3da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:46.660575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:46.680045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:46.715101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 52/108] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:07:46.716730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccbbf0-8d8c-481d-bf10-622dadf00a44 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:46.717212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccbbf0-8d8c-481d-bf10-622dadf00a44 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:46.717641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccbbf0-8d8c-481d-bf10-622dadf00a44 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:46.719133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 53/109] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:46.723109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7edf9-a43d-4192-8b30-978f2f6cf3da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:46.725425 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7edf9-a43d-4192-8b30-978f2f6cf3da None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:46.725550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112ee1-aa97-4318-b69c-6bca040f1cfe None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:46.725811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112ee1-aa97-4318-b69c-6bca040f1cfe None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:46.726102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112ee1-aa97-4318-b69c-6bca040f1cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:46.745347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1b112ee1-aa97-4318-b69c-6bca040f1cfe None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:46.746846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1b112ee1-aa97-4318-b69c-6bca040f1cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:46.824790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 54/110] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:07:46.825879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112ee1-aa97-4318-b69c-6bca040f1cfe None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:46.835031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 57/111] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:46.840728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7edf9-a43d-4192-8b30-978f2f6cf3da None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:46.902517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:46.947733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112ee1-aa97-4318-b69c-6bca040f1cfe None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:46.961260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:46.967115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7edf9-a43d-4192-8b30-978f2f6cf3da None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:46.993107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60fd69-28e9-42d6-b12c-0c4818db1a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:46.994608 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60fd69-28e9-42d6-b12c-0c4818db1a58 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:46.994991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60fd69-28e9-42d6-b12c-0c4818db1a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:46.995393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60fd69-28e9-42d6-b12c-0c4818db1a58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.006926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9101161-ff05-4db1-a9e7-eda36ccdc6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:47.007872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101161-ff05-4db1-a9e7-eda36ccdc6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.008141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60fd69-28e9-42d6-b12c-0c4818db1a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:47.008249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101161-ff05-4db1-a9e7-eda36ccdc6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.008438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101161-ff05-4db1-a9e7-eda36ccdc6f7 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.009657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9101161-ff05-4db1-a9e7-eda36ccdc6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:47.011157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9101161-ff05-4db1-a9e7-eda36ccdc6f7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:47.013036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 58/112] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:46 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:07:47.014295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514f53a-eb9b-44d8-8d1b-03e5dcf18216 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.014591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514f53a-eb9b-44d8-8d1b-03e5dcf18216 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.014929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514f53a-eb9b-44d8-8d1b-03e5dcf18216 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.016292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 59/113] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-ba60fd69-28e9-42d6-b12c-0c4818db1a58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:47.016860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:47.017766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:47.018536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:47.020382 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514f53a-eb9b-44d8-8d1b-03e5dcf18216 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:47.020508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 55/114] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:47.020508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60fd69-28e9-42d6-b12c-0c4818db1a58 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:47.139867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60fd69-28e9-42d6-b12c-0c4818db1a58 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:47.147805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514f53a-eb9b-44d8-8d1b-03e5dcf18216 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:47.163393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:47.174927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa55e9-82df-4601-b71a-d0ab1eedda71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:47.175623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa55e9-82df-4601-b71a-d0ab1eedda71 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.175921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa55e9-82df-4601-b71a-d0ab1eedda71 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.176206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa55e9-82df-4601-b71a-d0ab1eedda71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.177044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa55e9-82df-4601-b71a-d0ab1eedda71 None admin] RBAC: Adding query filter params (role.id=aa51c41209054701acd2b9e3bbe58114, scope.project.id=a91db3386fe24593821f7424072923f8, user.id=45cfbef997ac416e9a5450add3404a63) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:47.177387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa55e9-82df-4601-b71a-d0ab1eedda71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:47.178866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa55e9-82df-4601-b71a-d0ab1eedda71 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:47.187387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 56/115] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/role_assignments?user.id=45cfbef997ac416e9a5450add3404a63&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=aa51c41209054701acd2b9e3bbe58114 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:47.187387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205804b0-6acf-4061-a5cf-557d8d2abf7a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.187387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205804b0-6acf-4061-a5cf-557d8d2abf7a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.187387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205804b0-6acf-4061-a5cf-557d8d2abf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.190257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350f24d-1158-40ee-b032-d625545933d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:47.191268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350f24d-1158-40ee-b032-d625545933d2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.191924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350f24d-1158-40ee-b032-d625545933d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.192204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350f24d-1158-40ee-b032-d625545933d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.205769 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-205804b0-6acf-4061-a5cf-557d8d2abf7a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:47.207316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-205804b0-6acf-4061-a5cf-557d8d2abf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:47.211303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350f24d-1158-40ee-b032-d625545933d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a350f24d-1158-40ee-b032-d625545933d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:47.219749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:47.220672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:07:47.221443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 60/116] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:47.226776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350f24d-1158-40ee-b032-d625545933d2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:47.246319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:47.302574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 57/117] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:47.308935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189830b-0441-451b-a0ab-e1d57a25eba8 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.310762 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189830b-0441-451b-a0ab-e1d57a25eba8 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.311472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189830b-0441-451b-a0ab-e1d57a25eba8 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.314341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 58/118] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:47.316481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189830b-0441-451b-a0ab-e1d57a25eba8 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:47.389190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350f24d-1158-40ee-b032-d625545933d2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:47.438583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7ade0-7d95-48c4-a23c-338a89d707c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:47.439184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7ade0-7d95-48c4-a23c-338a89d707c1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.439504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7ade0-7d95-48c4-a23c-338a89d707c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.439794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7ade0-7d95-48c4-a23c-338a89d707c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.440563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7ade0-7d95-48c4-a23c-338a89d707c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:47.440880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7ade0-7d95-48c4-a23c-338a89d707c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:47.442271 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7ade0-7d95-48c4-a23c-338a89d707c1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:47.452695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 61/119] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:47.453985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64285c-8b41-4687-9072-5cb5b25e6f62 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.454282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64285c-8b41-4687-9072-5cb5b25e6f62 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.454575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64285c-8b41-4687-9072-5cb5b25e6f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.455419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189830b-0441-451b-a0ab-e1d57a25eba8 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:47.476782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5e64285c-8b41-4687-9072-5cb5b25e6f62 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:47.478112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5e64285c-8b41-4687-9072-5cb5b25e6f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:47.509818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190b943-9534-44e5-81a3-88febff4005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:47.511411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190b943-9534-44e5-81a3-88febff4005c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.512014 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190b943-9534-44e5-81a3-88febff4005c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.512537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190b943-9534-44e5-81a3-88febff4005c None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.513204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:47.514916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190b943-9534-44e5-81a3-88febff4005c None admin] RBAC: Adding query filter params (name=member) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:47.515683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190b943-9534-44e5-81a3-88febff4005c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:47.517820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190b943-9534-44e5-81a3-88febff4005c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:47.529033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 59/120] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:47.530669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190b943-9534-44e5-81a3-88febff4005c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:47.561816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 62/121] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:47.562900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64285c-8b41-4687-9072-5cb5b25e6f62 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:47.565060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:47.668374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190b943-9534-44e5-81a3-88febff4005c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:47.674932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64285c-8b41-4687-9072-5cb5b25e6f62 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:47.712042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19439725-9761-426c-b305-24556c23f513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:47.712968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19439725-9761-426c-b305-24556c23f513 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.713332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19439725-9761-426c-b305-24556c23f513 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.713678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19439725-9761-426c-b305-24556c23f513 None admin] PATH_INFO: `/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.714948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19439725-9761-426c-b305-24556c23f513 None admin] RBAC: Authorizing `identity:get_user(user_id=dc32afaae6ca4f2aa28cb24fd65dc652)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:47.715516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecd1a5-dc1a-420a-8830-60268797499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:47.716511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecd1a5-dc1a-420a-8830-60268797499d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.716627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19439725-9761-426c-b305-24556c23f513 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:47.717077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecd1a5-dc1a-420a-8830-60268797499d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.717534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecd1a5-dc1a-420a-8830-60268797499d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.718426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 63/122] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:47.723833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19439725-9761-426c-b305-24556c23f513 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:47.730166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecd1a5-dc1a-420a-8830-60268797499d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-2eecd1a5-dc1a-420a-8830-60268797499d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:47.740745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:47.741682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:47.742473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:47.744825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 60/123] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:47.751312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecd1a5-dc1a-420a-8830-60268797499d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:47.768745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:47.859365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:47.869869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19439725-9761-426c-b305-24556c23f513 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:47.878031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecd1a5-dc1a-420a-8830-60268797499d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:47.914245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6c03a-b38f-4fa8-8d77-0c426a13ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:47.915064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c03a-b38f-4fa8-8d77-0c426a13ea9c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.915375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c03a-b38f-4fa8-8d77-0c426a13ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.915664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c03a-b38f-4fa8-8d77-0c426a13ea9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.917902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d7333-9a04-41e2-a296-1b7d035c8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:47.919465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d7333-9a04-41e2-a296-1b7d035c8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:47.919982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d7333-9a04-41e2-a296-1b7d035c8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:47.920487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d7333-9a04-41e2-a296-1b7d035c8fc9 None admin] PATH_INFO: `/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:47.922240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d7333-9a04-41e2-a296-1b7d035c8fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=dc32afaae6ca4f2aa28cb24fd65dc652)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:47.924605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d7333-9a04-41e2-a296-1b7d035c8fc9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:47.926831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6c03a-b38f-4fa8-8d77-0c426a13ea9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:47.927290 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 64/124] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:47.928432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d7333-9a04-41e2-a296-1b7d035c8fc9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-9af6c03a-b38f-4fa8-8d77-0c426a13ea9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:47.935661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:47.936570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:47.937366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 61/125] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:47.938005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6c03a-b38f-4fa8-8d77-0c426a13ea9c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:48.040932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:48.045934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d7333-9a04-41e2-a296-1b7d035c8fc9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:48.074679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6c03a-b38f-4fa8-8d77-0c426a13ea9c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:48.083262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387c282-d3f1-451a-91f8-97a132f8e893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:48.084856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387c282-d3f1-451a-91f8-97a132f8e893 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:48.085144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387c282-d3f1-451a-91f8-97a132f8e893 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:48.085487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387c282-d3f1-451a-91f8-97a132f8e893 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:48.086767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387c282-d3f1-451a-91f8-97a132f8e893 None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:48.088311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387c282-d3f1-451a-91f8-97a132f8e893 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:48.090112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 65/126] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:48.090870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387c282-d3f1-451a-91f8-97a132f8e893 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:48.115269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c814285-4808-419b-bf2b-30116eb344cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:48.116040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c814285-4808-419b-bf2b-30116eb344cc None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:48.116308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c814285-4808-419b-bf2b-30116eb344cc None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:48.116643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c814285-4808-419b-bf2b-30116eb344cc None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:48.117407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c814285-4808-419b-bf2b-30116eb344cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:48.117720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c814285-4808-419b-bf2b-30116eb344cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:48.119315 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c814285-4808-419b-bf2b-30116eb344cc None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:48.128143 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 62/127] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:48.128997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c814285-4808-419b-bf2b-30116eb344cc None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:48.141413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:48.225663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387c282-d3f1-451a-91f8-97a132f8e893 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:48.240584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c814285-4808-419b-bf2b-30116eb344cc None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:48.267074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab711e-7adf-4258-b1c3-980212c09c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:48.267969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab711e-7adf-4258-b1c3-980212c09c95 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:48.268415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab711e-7adf-4258-b1c3-980212c09c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:48.268704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab711e-7adf-4258-b1c3-980212c09c95 None admin] PATH_INFO: `/v3/projects/f9432f44630344dd8d60b047a9b895bd` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:48.270151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab711e-7adf-4258-b1c3-980212c09c95 None admin] RBAC: Authorizing `identity:get_project(project_id=f9432f44630344dd8d60b047a9b895bd)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:48.271625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab711e-7adf-4258-b1c3-980212c09c95 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:48.273704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 66/128] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:48 2022] GET /identity/v3/projects/f9432f44630344dd8d60b047a9b895bd => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:48.274628 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab711e-7adf-4258-b1c3-980212c09c95 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:48.288516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4ca78-ba0a-47f5-af03-0908e95a23db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:48.289658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4ca78-ba0a-47f5-af03-0908e95a23db None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:48.289944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4ca78-ba0a-47f5-af03-0908e95a23db None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:48.290229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4ca78-ba0a-47f5-af03-0908e95a23db None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:48.291495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4ca78-ba0a-47f5-af03-0908e95a23db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:48.292041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4ca78-ba0a-47f5-af03-0908e95a23db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:48.293677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4ca78-ba0a-47f5-af03-0908e95a23db None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:48.305587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 63/129] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:07:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:48.306518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4ca78-ba0a-47f5-af03-0908e95a23db None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:48.322699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:48.397157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:48.412787 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab711e-7adf-4258-b1c3-980212c09c95 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:48.439909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4ca78-ba0a-47f5-af03-0908e95a23db None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:48.451088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e755f5-fda6-4b6e-8fe6-355f1d822919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:48.452608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e755f5-fda6-4b6e-8fe6-355f1d822919 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:48.453048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e755f5-fda6-4b6e-8fe6-355f1d822919 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:48.453461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e755f5-fda6-4b6e-8fe6-355f1d822919 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8/users/dc32afaae6ca4f2aa28cb24fd65dc652/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:48.455648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e755f5-fda6-4b6e-8fe6-355f1d822919 None admin] RBAC: Authorizing `identity:create_grant(project_id=a91db3386fe24593821f7424072923f8, user_id=dc32afaae6ca4f2aa28cb24fd65dc652, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:48.457231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e755f5-fda6-4b6e-8fe6-355f1d822919 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:48.475119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 67/130] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:07:48 2022] PUT /identity/v3/projects/a91db3386fe24593821f7424072923f8/users/dc32afaae6ca4f2aa28cb24fd65dc652/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:07:48.476274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e755f5-fda6-4b6e-8fe6-355f1d822919 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:48.487382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed14755-cacd-46cd-bbb5-06f7342ce63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:48.488478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14755-cacd-46cd-bbb5-06f7342ce63b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:48.488856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14755-cacd-46cd-bbb5-06f7342ce63b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:48.490454 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14755-cacd-46cd-bbb5-06f7342ce63b None admin] PATH_INFO: `/v3/users/6dac917bcc034de386b578ee9ad980f6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:48.496359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed14755-cacd-46cd-bbb5-06f7342ce63b None admin] RBAC: Authorizing `identity:get_user(user_id=6dac917bcc034de386b578ee9ad980f6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:48.498287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed14755-cacd-46cd-bbb5-06f7342ce63b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:48.500496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 64/131] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:48 2022] GET /identity/v3/users/6dac917bcc034de386b578ee9ad980f6 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:48.501439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed14755-cacd-46cd-bbb5-06f7342ce63b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:48.598132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:48.608922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e755f5-fda6-4b6e-8fe6-355f1d822919 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:48.651948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a110d7b-9bf4-4d35-b62d-143b118f92bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:48.653093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a110d7b-9bf4-4d35-b62d-143b118f92bb None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:48.653548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a110d7b-9bf4-4d35-b62d-143b118f92bb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:48.654244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a110d7b-9bf4-4d35-b62d-143b118f92bb None admin] PATH_INFO: `/v3/projects/f9432f44630344dd8d60b047a9b895bd/users/dc32afaae6ca4f2aa28cb24fd65dc652/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:48.657042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a110d7b-9bf4-4d35-b62d-143b118f92bb None admin] RBAC: Authorizing `identity:create_grant(project_id=f9432f44630344dd8d60b047a9b895bd, user_id=dc32afaae6ca4f2aa28cb24fd65dc652, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:48.659000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a110d7b-9bf4-4d35-b62d-143b118f92bb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:48.688324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 68/132] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:07:48 2022] PUT /identity/v3/projects/f9432f44630344dd8d60b047a9b895bd/users/dc32afaae6ca4f2aa28cb24fd65dc652/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:07:48.689512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a110d7b-9bf4-4d35-b62d-143b118f92bb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:48.775563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed14755-cacd-46cd-bbb5-06f7342ce63b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:48.818045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45081db5-28d5-41fd-902b-2e9939754fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:48.819141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45081db5-28d5-41fd-902b-2e9939754fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:48.819564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45081db5-28d5-41fd-902b-2e9939754fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:48.820012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45081db5-28d5-41fd-902b-2e9939754fb4 None admin] PATH_INFO: `/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:48.821378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45081db5-28d5-41fd-902b-2e9939754fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=dc32afaae6ca4f2aa28cb24fd65dc652)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:48.823024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45081db5-28d5-41fd-902b-2e9939754fb4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:48.825314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 65/133] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:48 2022] GET /identity/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:48.830793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45081db5-28d5-41fd-902b-2e9939754fb4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:48.836218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:48.913691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a110d7b-9bf4-4d35-b62d-143b118f92bb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:49.000732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966fb3d-86bc-48e9-88aa-4fd90ccaa58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:49.001627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966fb3d-86bc-48e9-88aa-4fd90ccaa58f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:49.001912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966fb3d-86bc-48e9-88aa-4fd90ccaa58f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:49.002194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966fb3d-86bc-48e9-88aa-4fd90ccaa58f None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:49.005027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966fb3d-86bc-48e9-88aa-4fd90ccaa58f None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:49.007085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966fb3d-86bc-48e9-88aa-4fd90ccaa58f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:49.007809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45081db5-28d5-41fd-902b-2e9939754fb4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:49.008888 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 69/134] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:48 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:49.016283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966fb3d-86bc-48e9-88aa-4fd90ccaa58f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:49.065314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a86423-5fcc-49d8-8a7c-d2ba2043e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:49.065933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:49.066199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a86423-5fcc-49d8-8a7c-d2ba2043e4ac None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:49.066488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a86423-5fcc-49d8-8a7c-d2ba2043e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:49.066795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a86423-5fcc-49d8-8a7c-d2ba2043e4ac None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:49.068714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a86423-5fcc-49d8-8a7c-d2ba2043e4ac None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:49.070204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a86423-5fcc-49d8-8a7c-d2ba2043e4ac None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:49.073876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 66/135] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:48 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:49.081175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a86423-5fcc-49d8-8a7c-d2ba2043e4ac None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:49.202523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966fb3d-86bc-48e9-88aa-4fd90ccaa58f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:49.256391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:49.279294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0a0cd-4e66-4de4-9186-fda59d02ede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:49.280223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0a0cd-4e66-4de4-9186-fda59d02ede0 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:49.280512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0a0cd-4e66-4de4-9186-fda59d02ede0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:49.280796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0a0cd-4e66-4de4-9186-fda59d02ede0 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8/users/6dac917bcc034de386b578ee9ad980f6/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:49.284272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0a0cd-4e66-4de4-9186-fda59d02ede0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a91db3386fe24593821f7424072923f8, user_id=6dac917bcc034de386b578ee9ad980f6, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:49.285725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0a0cd-4e66-4de4-9186-fda59d02ede0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:49.310910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 70/136] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:07:49 2022] PUT /identity/v3/projects/a91db3386fe24593821f7424072923f8/users/6dac917bcc034de386b578ee9ad980f6/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:07:49.312328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffffd42-aee3-40ee-b6f0-0e3199653914 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:49.312622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffffd42-aee3-40ee-b6f0-0e3199653914 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:49.312917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffffd42-aee3-40ee-b6f0-0e3199653914 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:49.314224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 71/137] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:49.317311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a86423-5fcc-49d8-8a7c-d2ba2043e4ac None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:49.326760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e6fe-dac5-431f-9057-80836ed70363 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:49.327114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e6fe-dac5-431f-9057-80836ed70363 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:49.327351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25e6fe-dac5-431f-9057-80836ed70363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:49.371263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ed25e6fe-dac5-431f-9057-80836ed70363 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:49.372978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ed25e6fe-dac5-431f-9057-80836ed70363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:49.416060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396741b-6675-4017-93ad-c8c0e797b8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:49.417082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396741b-6675-4017-93ad-c8c0e797b8b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:49.417368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396741b-6675-4017-93ad-c8c0e797b8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:49.417646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396741b-6675-4017-93ad-c8c0e797b8b0 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8/users/dc32afaae6ca4f2aa28cb24fd65dc652/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:49.420271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396741b-6675-4017-93ad-c8c0e797b8b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a91db3386fe24593821f7424072923f8, user_id=dc32afaae6ca4f2aa28cb24fd65dc652, role_id=8b03cb8cbf3248d1a22cd48ec5c21eb6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:49.421807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396741b-6675-4017-93ad-c8c0e797b8b0 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:49.453312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 67/138] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:07:49 2022] PUT /identity/v3/projects/a91db3386fe24593821f7424072923f8/users/dc32afaae6ca4f2aa28cb24fd65dc652/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:07:49.526221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 72/139] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:49.571833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396741b-6675-4017-93ad-c8c0e797b8b0 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:49.730851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dfc71-de71-4871-8c80-aed4c861b19b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:49.731183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dfc71-de71-4871-8c80-aed4c861b19b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:49.731399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dfc71-de71-4871-8c80-aed4c861b19b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:49.732937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 73/140] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:07:49.738604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef1ba4-50f7-47bd-be89-f1fde3436100 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:49.738929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef1ba4-50f7-47bd-be89-f1fde3436100 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:49.739173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef1ba4-50f7-47bd-be89-f1fde3436100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:49.739615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396741b-6675-4017-93ad-c8c0e797b8b0 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:49.758795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0bef1ba4-50f7-47bd-be89-f1fde3436100 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:49.760052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0bef1ba4-50f7-47bd-be89-f1fde3436100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:49.772244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:49.784339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:49.789047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad1934-acf3-4425-8f54-54c8ae0ec5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:49.789884 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1934-acf3-4425-8f54-54c8ae0ec5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:49.790179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1934-acf3-4425-8f54-54c8ae0ec5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:49.790466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad1934-acf3-4425-8f54-54c8ae0ec5a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:49.791772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad1934-acf3-4425-8f54-54c8ae0ec5a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:49.793629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad1934-acf3-4425-8f54-54c8ae0ec5a4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:49.795418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 68/141] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:49.802982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad1934-acf3-4425-8f54-54c8ae0ec5a4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:49.869509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 74/142] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:07:49.905201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef1ba4-50f7-47bd-be89-f1fde3436100 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:49.952688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad1934-acf3-4425-8f54-54c8ae0ec5a4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:50.044190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65133c06-0131-4cb2-9838-058fbb6fc3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:50.044810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65133c06-0131-4cb2-9838-058fbb6fc3af None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:50.045106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65133c06-0131-4cb2-9838-058fbb6fc3af None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:50.045392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65133c06-0131-4cb2-9838-058fbb6fc3af None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:50.046139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65133c06-0131-4cb2-9838-058fbb6fc3af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:50.047934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65133c06-0131-4cb2-9838-058fbb6fc3af None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:50.087828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 69/143] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:07:49 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:50.093925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef1ba4-50f7-47bd-be89-f1fde3436100 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:50.137856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91858074-86c0-49eb-ae3c-449ad0a08dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:50.139114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91858074-86c0-49eb-ae3c-449ad0a08dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:50.139670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91858074-86c0-49eb-ae3c-449ad0a08dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:50.140167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91858074-86c0-49eb-ae3c-449ad0a08dc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:50.158518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91858074-86c0-49eb-ae3c-449ad0a08dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-91858074-86c0-49eb-ae3c-449ad0a08dc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:50.167036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:50.167997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:07:50.168793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:07:50.171313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 75/144] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:07:50.179156 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65133c06-0131-4cb2-9838-058fbb6fc3af None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:50.250589 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:50.300738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65133c06-0131-4cb2-9838-058fbb6fc3af None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:50.338679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d34cec-f753-47a9-aac1-367385a4ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:50.339829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d34cec-f753-47a9-aac1-367385a4ca40 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:50.340317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d34cec-f753-47a9-aac1-367385a4ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:50.340809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d34cec-f753-47a9-aac1-367385a4ca40 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:50.341764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d34cec-f753-47a9-aac1-367385a4ca40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:50.342270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d34cec-f753-47a9-aac1-367385a4ca40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:50.343937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d34cec-f753-47a9-aac1-367385a4ca40 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:50.353929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 70/145] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:07:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:50.359834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91858074-86c0-49eb-ae3c-449ad0a08dc6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:50.363675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:50.511437 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91858074-86c0-49eb-ae3c-449ad0a08dc6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:50.556891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b4f46-d8e5-45c4-a6b2-d4de597f42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:50.557700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b4f46-d8e5-45c4-a6b2-d4de597f42ff None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:50.557984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b4f46-d8e5-45c4-a6b2-d4de597f42ff None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:50.558260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b4f46-d8e5-45c4-a6b2-d4de597f42ff None admin] PATH_INFO: `/v3/users/45cfbef997ac416e9a5450add3404a63` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:50.559507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b4f46-d8e5-45c4-a6b2-d4de597f42ff None admin] RBAC: Authorizing `identity:get_user(user_id=45cfbef997ac416e9a5450add3404a63)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:50.560985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b4f46-d8e5-45c4-a6b2-d4de597f42ff None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:50.562802 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 76/146] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:50 2022] GET /identity/v3/users/45cfbef997ac416e9a5450add3404a63 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:50.569020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d34cec-f753-47a9-aac1-367385a4ca40 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:50.697403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d34cec-f753-47a9-aac1-367385a4ca40 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:50.724931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:50.737979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c5e77-c2a9-470c-be30-2b941da67a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:50.738919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5e77-c2a9-470c-be30-2b941da67a5e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:50.739215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5e77-c2a9-470c-be30-2b941da67a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:50.739525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c5e77-c2a9-470c-be30-2b941da67a5e None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:50.740897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c5e77-c2a9-470c-be30-2b941da67a5e None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:50.742418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c5e77-c2a9-470c-be30-2b941da67a5e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:50.744184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 71/147] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:50 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:50.750035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b4f46-d8e5-45c4-a6b2-d4de597f42ff None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:50.835678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:50.873052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b4f46-d8e5-45c4-a6b2-d4de597f42ff None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:50.908742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570ea6a-efe0-4edc-bcc6-5af75ee4d019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:50.909650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570ea6a-efe0-4edc-bcc6-5af75ee4d019 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:50.909934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570ea6a-efe0-4edc-bcc6-5af75ee4d019 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:50.910213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570ea6a-efe0-4edc-bcc6-5af75ee4d019 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8/users/45cfbef997ac416e9a5450add3404a63/roles/aa51c41209054701acd2b9e3bbe58114` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:50.912280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570ea6a-efe0-4edc-bcc6-5af75ee4d019 None admin] RBAC: Authorizing `identity:create_grant(project_id=a91db3386fe24593821f7424072923f8, user_id=45cfbef997ac416e9a5450add3404a63, role_id=aa51c41209054701acd2b9e3bbe58114)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:50.913740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570ea6a-efe0-4edc-bcc6-5af75ee4d019 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:50.934511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 77/148] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:07:50 2022] PUT /identity/v3/projects/a91db3386fe24593821f7424072923f8/users/45cfbef997ac416e9a5450add3404a63/roles/aa51c41209054701acd2b9e3bbe58114 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:07:51.641777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc1e61-72aa-4cac-b3c6-91ff7d2a2e0e None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:51.642165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc1e61-72aa-4cac-b3c6-91ff7d2a2e0e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:51.642339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc1e61-72aa-4cac-b3c6-91ff7d2a2e0e None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:51.643777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 72/149] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:51.649180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371591b-0813-44db-9a17-6c13710cc826 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:51.649610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371591b-0813-44db-9a17-6c13710cc826 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:51.649808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371591b-0813-44db-9a17-6c13710cc826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:51.667204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1371591b-0813-44db-9a17-6c13710cc826 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:51.672498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1371591b-0813-44db-9a17-6c13710cc826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:51.750457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 78/150] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:51.789796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc1e61-72aa-4cac-b3c6-91ff7d2a2e0e None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:51.916117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc1e61-72aa-4cac-b3c6-91ff7d2a2e0e None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:51.955985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32bbb2-54c6-489c-8bd6-70a1fd73c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:51.956810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32bbb2-54c6-489c-8bd6-70a1fd73c9ae None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:51.957093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32bbb2-54c6-489c-8bd6-70a1fd73c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:51.957374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32bbb2-54c6-489c-8bd6-70a1fd73c9ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:51.973789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32bbb2-54c6-489c-8bd6-70a1fd73c9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-fb32bbb2-54c6-489c-8bd6-70a1fd73c9ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:51.982360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:51.983300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:51.984094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:51.988255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 73/151] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:51.993878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371591b-0813-44db-9a17-6c13710cc826 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:52.086654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:52.135696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371591b-0813-44db-9a17-6c13710cc826 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:52.185812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b410f13-c281-41de-aaaa-cbe5486b5c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:52.186491 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b410f13-c281-41de-aaaa-cbe5486b5c6e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:52.186776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b410f13-c281-41de-aaaa-cbe5486b5c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:52.187056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b410f13-c281-41de-aaaa-cbe5486b5c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:52.187851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b410f13-c281-41de-aaaa-cbe5486b5c6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:52.188161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b410f13-c281-41de-aaaa-cbe5486b5c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:52.189542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b410f13-c281-41de-aaaa-cbe5486b5c6e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:52.201705 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 79/152] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:07:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:52.207453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32bbb2-54c6-489c-8bd6-70a1fd73c9ae None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:52.284345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:52.359711 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32bbb2-54c6-489c-8bd6-70a1fd73c9ae None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:52.407242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464c118-6c98-4108-8c66-f9ddb943420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:52.408177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c118-6c98-4108-8c66-f9ddb943420b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:52.408466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c118-6c98-4108-8c66-f9ddb943420b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:52.408748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c118-6c98-4108-8c66-f9ddb943420b None admin] PATH_INFO: `/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:52.410010 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464c118-6c98-4108-8c66-f9ddb943420b None admin] RBAC: Authorizing `identity:get_user(user_id=dc32afaae6ca4f2aa28cb24fd65dc652)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:52.411539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464c118-6c98-4108-8c66-f9ddb943420b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:52.413275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 74/153] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:52 2022] GET /identity/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:52.420441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b410f13-c281-41de-aaaa-cbe5486b5c6e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:52.587865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b410f13-c281-41de-aaaa-cbe5486b5c6e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:52.611845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:52.632507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864587d-b777-4692-a5c8-e3672d2b387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:52.633223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864587d-b777-4692-a5c8-e3672d2b387f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:52.633515 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864587d-b777-4692-a5c8-e3672d2b387f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:52.633796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864587d-b777-4692-a5c8-e3672d2b387f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:52.714372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864587d-b777-4692-a5c8-e3672d2b387f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:52.715962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864587d-b777-4692-a5c8-e3672d2b387f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:52.819318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 80/154] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:52.825214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464c118-6c98-4108-8c66-f9ddb943420b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:52.934223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c55fd8-1011-4e0e-9f3d-31fe43f85823 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:52.934558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c55fd8-1011-4e0e-9f3d-31fe43f85823 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:52.934978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c55fd8-1011-4e0e-9f3d-31fe43f85823 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:52.936590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 81/155] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:52.946784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714356-59fe-4850-986d-099d6550c1f9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:52.947077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714356-59fe-4850-986d-099d6550c1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:52.947376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714356-59fe-4850-986d-099d6550c1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:52.979187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-97714356-59fe-4850-986d-099d6550c1f9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:52.981106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-97714356-59fe-4850-986d-099d6550c1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:53.012991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:53.057303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464c118-6c98-4108-8c66-f9ddb943420b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:53.107703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:53.117002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 82/156] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 07 14:07:53.118400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02a60-9aa3-402f-8eba-e756f6ba570b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:53.118692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02a60-9aa3-402f-8eba-e756f6ba570b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:53.118973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02a60-9aa3-402f-8eba-e756f6ba570b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:53.120410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 83/157] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:53.125704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d299fa-357e-4647-95f4-f7cabc28598a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:53.125997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d299fa-357e-4647-95f4-f7cabc28598a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:53.126260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d299fa-357e-4647-95f4-f7cabc28598a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:53.168365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-93d299fa-357e-4647-95f4-f7cabc28598a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:53.169798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-93d299fa-357e-4647-95f4-f7cabc28598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:53.170840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b1753-83b4-4a26-80cc-d2d2f2c298a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:53.171997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1753-83b4-4a26-80cc-d2d2f2c298a5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:53.172434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1753-83b4-4a26-80cc-d2d2f2c298a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:53.172880 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b1753-83b4-4a26-80cc-d2d2f2c298a5 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:53.174302 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b1753-83b4-4a26-80cc-d2d2f2c298a5 None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:53.175939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b1753-83b4-4a26-80cc-d2d2f2c298a5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:53.181986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 75/158] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:52 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:53.183094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b1753-83b4-4a26-80cc-d2d2f2c298a5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:53.338983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 84/159] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:07:53.342965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d299fa-357e-4647-95f4-f7cabc28598a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:53.431971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b1753-83b4-4a26-80cc-d2d2f2c298a5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:53.524888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924ee50-44c9-431f-a843-2512adf0326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:53.525708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924ee50-44c9-431f-a843-2512adf0326b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:53.525992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924ee50-44c9-431f-a843-2512adf0326b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:53.526268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924ee50-44c9-431f-a843-2512adf0326b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:53.552241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924ee50-44c9-431f-a843-2512adf0326b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:53.556580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-f924ee50-44c9-431f-a843-2512adf0326b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:53.560952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:53.561841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:53.562646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 76/160] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:07:53.572628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe324-07f8-4adc-a5be-b6d2155444f9 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:53.572923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe324-07f8-4adc-a5be-b6d2155444f9 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:53.573474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe324-07f8-4adc-a5be-b6d2155444f9 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:53.574942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 77/161] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:53.575603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbe324-07f8-4adc-a5be-b6d2155444f9 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:53.617585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d299fa-357e-4647-95f4-f7cabc28598a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:53.679486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff651b-1c4b-4e51-b70f-5a3adbe0ff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:53.680392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff651b-1c4b-4e51-b70f-5a3adbe0ff1a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:53.680824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff651b-1c4b-4e51-b70f-5a3adbe0ff1a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:53.681417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff651b-1c4b-4e51-b70f-5a3adbe0ff1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:53.682406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff651b-1c4b-4e51-b70f-5a3adbe0ff1a None admin] RBAC: Adding query filter params (role.id=a284a48d48b2440997815469786a10ec, scope.project.id=a91db3386fe24593821f7424072923f8, user.id=dc32afaae6ca4f2aa28cb24fd65dc652) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:53.682927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff651b-1c4b-4e51-b70f-5a3adbe0ff1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:53.684569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff651b-1c4b-4e51-b70f-5a3adbe0ff1a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:53.700196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 85/162] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:53 2022] GET /identity/v3/role_assignments?user.id=dc32afaae6ca4f2aa28cb24fd65dc652&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=a284a48d48b2440997815469786a10ec => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:53.701260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff651b-1c4b-4e51-b70f-5a3adbe0ff1a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:53.711459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:53.861925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff651b-1c4b-4e51-b70f-5a3adbe0ff1a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:53.950465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b38b7-b9df-4efa-a895-29f618ada592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:53.951148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b38b7-b9df-4efa-a895-29f618ada592 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:53.951453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b38b7-b9df-4efa-a895-29f618ada592 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:53.951735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b38b7-b9df-4efa-a895-29f618ada592 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:53.952499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b38b7-b9df-4efa-a895-29f618ada592 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:53.952803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b38b7-b9df-4efa-a895-29f618ada592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:53.954178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b38b7-b9df-4efa-a895-29f618ada592 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:53.970282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbe324-07f8-4adc-a5be-b6d2155444f9 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:53.971125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 86/163] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:07:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:53.972523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d87db-ffe5-4a84-a7d4-bfe9061cfc03 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:53.972809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d87db-ffe5-4a84-a7d4-bfe9061cfc03 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:53.973082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d87db-ffe5-4a84-a7d4-bfe9061cfc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:54.016357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-653d87db-ffe5-4a84-a7d4-bfe9061cfc03 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:54.017773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-653d87db-ffe5-4a84-a7d4-bfe9061cfc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:54.020045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:54.030519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c584c3-c418-4a46-ba74-5c66008181ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:54.031662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c584c3-c418-4a46-ba74-5c66008181ac None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:54.032093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c584c3-c418-4a46-ba74-5c66008181ac None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:54.032513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c584c3-c418-4a46-ba74-5c66008181ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:54.044493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c584c3-c418-4a46-ba74-5c66008181ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-f0c584c3-c418-4a46-ba74-5c66008181ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:54.054263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:54.055385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:07:54.056387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:54.058918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 78/164] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:07:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:54.060111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c584c3-c418-4a46-ba74-5c66008181ac None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:54.214230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 87/165] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:54.215041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d87db-ffe5-4a84-a7d4-bfe9061cfc03 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:54.279909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c584c3-c418-4a46-ba74-5c66008181ac None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:54.282063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:54.368640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63353412-7314-40cb-925b-c9c558176009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:54.369546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63353412-7314-40cb-925b-c9c558176009 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:54.369834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63353412-7314-40cb-925b-c9c558176009 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:54.370111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63353412-7314-40cb-925b-c9c558176009 None admin] PATH_INFO: `/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:54.371358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63353412-7314-40cb-925b-c9c558176009 None admin] RBAC: Authorizing `identity:get_user(user_id=dc32afaae6ca4f2aa28cb24fd65dc652)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:54.372831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63353412-7314-40cb-925b-c9c558176009 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:54.374665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 79/166] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:54 2022] GET /identity/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:54.375265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63353412-7314-40cb-925b-c9c558176009 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:54.399782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d87db-ffe5-4a84-a7d4-bfe9061cfc03 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:54.448940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1f30e-5b02-4f82-b8bf-d4a1919276fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:54.449642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1f30e-5b02-4f82-b8bf-d4a1919276fa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:54.449929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1f30e-5b02-4f82-b8bf-d4a1919276fa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:54.450205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1f30e-5b02-4f82-b8bf-d4a1919276fa None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:54.450997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1f30e-5b02-4f82-b8bf-d4a1919276fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:54.451305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1f30e-5b02-4f82-b8bf-d4a1919276fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:54.452756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1f30e-5b02-4f82-b8bf-d4a1919276fa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:54.459356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:54.467944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 88/167] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:07:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:54.468964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1f30e-5b02-4f82-b8bf-d4a1919276fa None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:54.614709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63353412-7314-40cb-925b-c9c558176009 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:54.684069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56bcd4-c3eb-48b6-84a5-7b4c34b50a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:54.684882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56bcd4-c3eb-48b6-84a5-7b4c34b50a5b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:54.685169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56bcd4-c3eb-48b6-84a5-7b4c34b50a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:54.685446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56bcd4-c3eb-48b6-84a5-7b4c34b50a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:54.689824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1f30e-5b02-4f82-b8bf-d4a1919276fa None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:54.710316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56bcd4-c3eb-48b6-84a5-7b4c34b50a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-1d56bcd4-c3eb-48b6-84a5-7b4c34b50a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:54.718292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:54.719493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:54.720334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:54.722874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 80/168] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:54.723886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56bcd4-c3eb-48b6-84a5-7b4c34b50a5b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:54.754776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58482dd0-ea7f-48a2-ac37-b9b331820ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:54.756074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482dd0-ea7f-48a2-ac37-b9b331820ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:54.756431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482dd0-ea7f-48a2-ac37-b9b331820ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:54.757058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58482dd0-ea7f-48a2-ac37-b9b331820ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:54.759802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:54.865131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56bcd4-c3eb-48b6-84a5-7b4c34b50a5b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:54.876641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482dd0-ea7f-48a2-ac37-b9b331820ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:54.878786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58482dd0-ea7f-48a2-ac37-b9b331820ad9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:54.887764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:54.902570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3477c-10ea-45db-8847-2da965d9d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:54.903593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3477c-10ea-45db-8847-2da965d9d605 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:54.903877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3477c-10ea-45db-8847-2da965d9d605 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:54.904153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3477c-10ea-45db-8847-2da965d9d605 None admin] PATH_INFO: `/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:54.905389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3477c-10ea-45db-8847-2da965d9d605 None admin] RBAC: Authorizing `identity:get_user(user_id=dc32afaae6ca4f2aa28cb24fd65dc652)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:54.906850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3477c-10ea-45db-8847-2da965d9d605 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:54.909025 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 81/169] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:54 2022] GET /identity/v3/users/dc32afaae6ca4f2aa28cb24fd65dc652 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:54.910535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784539ca-4ab5-4691-92be-cbf7aef0a925 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:54.911026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784539ca-4ab5-4691-92be-cbf7aef0a925 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:54.911569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784539ca-4ab5-4691-92be-cbf7aef0a925 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:54.913284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 82/170] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:54.918069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784539ca-4ab5-4691-92be-cbf7aef0a925 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:54.984395 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 89/171] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:54.986148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e567d2-5a37-49f4-b380-43528eb29988 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:54.986614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e567d2-5a37-49f4-b380-43528eb29988 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:54.987066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e567d2-5a37-49f4-b380-43528eb29988 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:54.988778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 90/172] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:54.990249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e567d2-5a37-49f4-b380-43528eb29988 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:55.024111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:55.029553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784539ca-4ab5-4691-92be-cbf7aef0a925 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:55.068602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1969922-ce27-48ed-8f3d-978f0d79dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:55.069523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1969922-ce27-48ed-8f3d-978f0d79dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.069988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1969922-ce27-48ed-8f3d-978f0d79dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.070407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1969922-ce27-48ed-8f3d-978f0d79dcb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.071309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1969922-ce27-48ed-8f3d-978f0d79dcb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:55.071797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1969922-ce27-48ed-8f3d-978f0d79dcb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:55.073574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1969922-ce27-48ed-8f3d-978f0d79dcb7 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:55.082599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 83/173] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:55.084238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44801c68-6105-4b93-907b-a5b78ed73fea None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.084679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44801c68-6105-4b93-907b-a5b78ed73fea None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.085102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44801c68-6105-4b93-907b-a5b78ed73fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.101961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-44801c68-6105-4b93-907b-a5b78ed73fea None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:55.103428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-44801c68-6105-4b93-907b-a5b78ed73fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:55.103760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e567d2-5a37-49f4-b380-43528eb29988 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:55.119732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:55.146793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af14a33-276e-4bb5-aed1-920885dc2161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:55.147848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af14a33-276e-4bb5-aed1-920885dc2161 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.148381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af14a33-276e-4bb5-aed1-920885dc2161 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.148831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af14a33-276e-4bb5-aed1-920885dc2161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.179134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 84/174] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:55.180091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44801c68-6105-4b93-907b-a5b78ed73fea None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:55.237763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af14a33-276e-4bb5-aed1-920885dc2161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:55.240874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af14a33-276e-4bb5-aed1-920885dc2161 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:55.298513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:55.310540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44801c68-6105-4b93-907b-a5b78ed73fea None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:55.342012 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:55.351996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2ed9-22c4-4fb7-a7c2-594ae382b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:55.351996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2ed9-22c4-4fb7-a7c2-594ae382b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.351996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2ed9-22c4-4fb7-a7c2-594ae382b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.351996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2ed9-22c4-4fb7-a7c2-594ae382b8f7 None admin] PATH_INFO: `/v3/projects/f9432f44630344dd8d60b047a9b895bd` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.352358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2ed9-22c4-4fb7-a7c2-594ae382b8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=f9432f44630344dd8d60b047a9b895bd)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:55.352610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 91/175] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:55.353965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2ed9-22c4-4fb7-a7c2-594ae382b8f7 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:55.354349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529d6a-d02b-4172-99c0-e2b43b994fd0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.354849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529d6a-d02b-4172-99c0-e2b43b994fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.355311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529d6a-d02b-4172-99c0-e2b43b994fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.355839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 85/176] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:55 2022] GET /identity/v3/projects/f9432f44630344dd8d60b047a9b895bd => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:55.356471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2ed9-22c4-4fb7-a7c2-594ae382b8f7 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:55.374468 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f6529d6a-d02b-4172-99c0-e2b43b994fd0 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:55.376189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f6529d6a-d02b-4172-99c0-e2b43b994fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:55.451606 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 92/177] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:55.452615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6529d6a-d02b-4172-99c0-e2b43b994fd0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:55.471391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2ed9-22c4-4fb7-a7c2-594ae382b8f7 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:55.520863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006acd8-cfa6-4753-b892-b2d9f2e49587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:55.521792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006acd8-cfa6-4753-b892-b2d9f2e49587 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.522157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006acd8-cfa6-4753-b892-b2d9f2e49587 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.522442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006acd8-cfa6-4753-b892-b2d9f2e49587 None admin] PATH_INFO: `/v3/users/6dac917bcc034de386b578ee9ad980f6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.523752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006acd8-cfa6-4753-b892-b2d9f2e49587 None admin] RBAC: Authorizing `identity:get_user(user_id=6dac917bcc034de386b578ee9ad980f6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:55.525411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006acd8-cfa6-4753-b892-b2d9f2e49587 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:55.527285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 86/178] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:55 2022] GET /identity/v3/users/6dac917bcc034de386b578ee9ad980f6 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:55.528151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006acd8-cfa6-4753-b892-b2d9f2e49587 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:55.558417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:55.562486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6529d6a-d02b-4172-99c0-e2b43b994fd0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:55.590704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:55.596587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81cb3e-7251-4f17-b2c6-db0a3dd49253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:55.597385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81cb3e-7251-4f17-b2c6-db0a3dd49253 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.597695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81cb3e-7251-4f17-b2c6-db0a3dd49253 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.597970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81cb3e-7251-4f17-b2c6-db0a3dd49253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.608470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81cb3e-7251-4f17-b2c6-db0a3dd49253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ff81cb3e-7251-4f17-b2c6-db0a3dd49253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:55.616683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:55.617526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:07:55.618305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 93/179] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:07:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:55.618955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81cb3e-7251-4f17-b2c6-db0a3dd49253 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:55.635382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006acd8-cfa6-4753-b892-b2d9f2e49587 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:55.670144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf457a1-770d-4776-84e5-0e30c7080c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:55.671001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf457a1-770d-4776-84e5-0e30c7080c59 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.671281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf457a1-770d-4776-84e5-0e30c7080c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.671589 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf457a1-770d-4776-84e5-0e30c7080c59 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.672764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf457a1-770d-4776-84e5-0e30c7080c59 None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:55.674275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf457a1-770d-4776-84e5-0e30c7080c59 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:55.676174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 87/180] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:55 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:55.676936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf457a1-770d-4776-84e5-0e30c7080c59 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:55.722364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81cb3e-7251-4f17-b2c6-db0a3dd49253 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:55.755695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e06a74-31d2-423a-8413-010aac2ad9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:55.756267 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06a74-31d2-423a-8413-010aac2ad9aa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.756551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06a74-31d2-423a-8413-010aac2ad9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.756827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e06a74-31d2-423a-8413-010aac2ad9aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.757657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e06a74-31d2-423a-8413-010aac2ad9aa None admin] RBAC: Adding query filter params (role.id=a284a48d48b2440997815469786a10ec, scope.project.id=f9432f44630344dd8d60b047a9b895bd, user.id=dc32afaae6ca4f2aa28cb24fd65dc652) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:55.757967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e06a74-31d2-423a-8413-010aac2ad9aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:55.759424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e06a74-31d2-423a-8413-010aac2ad9aa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:55.765082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 94/181] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:55 2022] GET /identity/v3/role_assignments?user.id=dc32afaae6ca4f2aa28cb24fd65dc652&scope.project.id=f9432f44630344dd8d60b047a9b895bd&role.id=a284a48d48b2440997815469786a10ec => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:55.766255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607ecac-2673-4c16-8a89-11927959d50a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.766539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607ecac-2673-4c16-8a89-11927959d50a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.766813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607ecac-2673-4c16-8a89-11927959d50a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.768062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 95/182] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:55.771522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607ecac-2673-4c16-8a89-11927959d50a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:55.773358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:55.781906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf457a1-770d-4776-84e5-0e30c7080c59 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:55.825255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf6847-bee8-4ffd-973e-d99deb62f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:55.826094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf6847-bee8-4ffd-973e-d99deb62f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.826375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf6847-bee8-4ffd-973e-d99deb62f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.826647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf6847-bee8-4ffd-973e-d99deb62f7b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.842598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf6847-bee8-4ffd-973e-d99deb62f7b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:55.846668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e9bf6847-bee8-4ffd-973e-d99deb62f7b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:55.853858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:55.854823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:07:55.855685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 88/183] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:55.857239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6a72a-4172-4132-ace6-f0eea00f6b32 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.857239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6a72a-4172-4132-ace6-f0eea00f6b32 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.857239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6a72a-4172-4132-ace6-f0eea00f6b32 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.858495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 89/184] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:55.863172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6a72a-4172-4132-ace6-f0eea00f6b32 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:55.907144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607ecac-2673-4c16-8a89-11927959d50a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:55.944535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b9893-c4af-4ff2-adeb-739de48b2b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:55.945198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b9893-c4af-4ff2-adeb-739de48b2b56 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:55.945589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b9893-c4af-4ff2-adeb-739de48b2b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:55.945753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b9893-c4af-4ff2-adeb-739de48b2b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:55.987243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6a72a-4172-4132-ace6-f0eea00f6b32 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.027262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b9893-c4af-4ff2-adeb-739de48b2b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.028681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b9893-c4af-4ff2-adeb-739de48b2b56 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.028801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f29b4-5f2d-4dd1-b63a-dea49f65233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.029403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f29b4-5f2d-4dd1-b63a-dea49f65233d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.029686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f29b4-5f2d-4dd1-b63a-dea49f65233d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.029957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f29b4-5f2d-4dd1-b63a-dea49f65233d None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.030707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f29b4-5f2d-4dd1-b63a-dea49f65233d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:56.031010 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f29b4-5f2d-4dd1-b63a-dea49f65233d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.032457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f29b4-5f2d-4dd1-b63a-dea49f65233d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.041881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 90/185] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:56.042682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f29b4-5f2d-4dd1-b63a-dea49f65233d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.061974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:56.084196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:56.128141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 96/186] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:56.129545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff26dce-c73a-455f-af78-63f72299b4a2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.129836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff26dce-c73a-455f-af78-63f72299b4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.130625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff26dce-c73a-455f-af78-63f72299b4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.146872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0ff26dce-c73a-455f-af78-63f72299b4a2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:56.148084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0ff26dce-c73a-455f-af78-63f72299b4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:56.148895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f29b4-5f2d-4dd1-b63a-dea49f65233d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.181037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ec53-d0b0-41dd-bf75-3fefb235322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.181664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ec53-d0b0-41dd-bf75-3fefb235322b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.181948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ec53-d0b0-41dd-bf75-3fefb235322b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.182223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2ec53-d0b0-41dd-bf75-3fefb235322b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.183057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2ec53-d0b0-41dd-bf75-3fefb235322b None admin] RBAC: Adding query filter params (role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=a91db3386fe24593821f7424072923f8, user.id=dc32afaae6ca4f2aa28cb24fd65dc652) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:56.183394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2ec53-d0b0-41dd-bf75-3fefb235322b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.184823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2ec53-d0b0-41dd-bf75-3fefb235322b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.190582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 91/187] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/role_assignments?user.id=dc32afaae6ca4f2aa28cb24fd65dc652&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:56.190582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ec53-d0b0-41dd-bf75-3fefb235322b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.224139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 97/188] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:56.225293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea56b38-b7c5-4716-b401-d316231f1d41 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.225578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea56b38-b7c5-4716-b401-d316231f1d41 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.225861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea56b38-b7c5-4716-b401-d316231f1d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.245420 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8ea56b38-b7c5-4716-b401-d316231f1d41 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:56.246807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8ea56b38-b7c5-4716-b401-d316231f1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:56.297298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:56.319410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2ec53-d0b0-41dd-bf75-3fefb235322b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.325672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 98/189] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:56.329018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea56b38-b7c5-4716-b401-d316231f1d41 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.352333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:56.359274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbfe9c-2f2b-4051-ab47-6f609f14da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.359990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbfe9c-2f2b-4051-ab47-6f609f14da51 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.360274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbfe9c-2f2b-4051-ab47-6f609f14da51 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.360549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbfe9c-2f2b-4051-ab47-6f609f14da51 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.361845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbfe9c-2f2b-4051-ab47-6f609f14da51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:56.362318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbfe9c-2f2b-4051-ab47-6f609f14da51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.363767 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbfe9c-2f2b-4051-ab47-6f609f14da51 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.372945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 92/190] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:56.373891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbfe9c-2f2b-4051-ab47-6f609f14da51 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.455971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea56b38-b7c5-4716-b401-d316231f1d41 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.490480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63d42-f1b0-4535-8630-17d0a3d6747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.491370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63d42-f1b0-4535-8630-17d0a3d6747b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.491665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63d42-f1b0-4535-8630-17d0a3d6747b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.491948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63d42-f1b0-4535-8630-17d0a3d6747b None admin] PATH_INFO: `/v3/users/1cf5338b44b24b73923a286bc46d2ec9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.494740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbfe9c-2f2b-4051-ab47-6f609f14da51 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.507042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde63d42-f1b0-4535-8630-17d0a3d6747b None admin] RBAC: Authorizing `identity:get_user(user_id=1cf5338b44b24b73923a286bc46d2ec9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.508522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde63d42-f1b0-4535-8630-17d0a3d6747b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.510295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 99/191] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/users/1cf5338b44b24b73923a286bc46d2ec9 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:56.511066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63d42-f1b0-4535-8630-17d0a3d6747b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.531361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15165e19-3b44-4c4f-8fd1-bf0561d33f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.532245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15165e19-3b44-4c4f-8fd1-bf0561d33f7b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.532527 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15165e19-3b44-4c4f-8fd1-bf0561d33f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.532805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15165e19-3b44-4c4f-8fd1-bf0561d33f7b None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.533998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15165e19-3b44-4c4f-8fd1-bf0561d33f7b None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.535446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15165e19-3b44-4c4f-8fd1-bf0561d33f7b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.541731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 93/192] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:56.541731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15165e19-3b44-4c4f-8fd1-bf0561d33f7b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.549971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:56.585042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:56.613249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63d42-f1b0-4535-8630-17d0a3d6747b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.637854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15165e19-3b44-4c4f-8fd1-bf0561d33f7b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.645843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d821a9-c434-4f8a-9528-2836d0efca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.646644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d821a9-c434-4f8a-9528-2836d0efca6e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.646927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d821a9-c434-4f8a-9528-2836d0efca6e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.647227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d821a9-c434-4f8a-9528-2836d0efca6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.657284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d821a9-c434-4f8a-9528-2836d0efca6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-91d821a9-c434-4f8a-9528-2836d0efca6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:07:56.665399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:07:56.666389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:07:56.667189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 100/193] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:07:56.667879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d821a9-c434-4f8a-9528-2836d0efca6e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.671413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026bfe-5e6d-43c9-b087-b000ed51c9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.672214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026bfe-5e6d-43c9-b087-b000ed51c9fc None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.672500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026bfe-5e6d-43c9-b087-b000ed51c9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.672779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026bfe-5e6d-43c9-b087-b000ed51c9fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.673967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026bfe-5e6d-43c9-b087-b000ed51c9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.675444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026bfe-5e6d-43c9-b087-b000ed51c9fc None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.677601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 94/194] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:56.678363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026bfe-5e6d-43c9-b087-b000ed51c9fc None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.756907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:56.768983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d821a9-c434-4f8a-9528-2836d0efca6e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.778685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026bfe-5e6d-43c9-b087-b000ed51c9fc None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.797840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:56.803730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38018a-0430-4e3c-8c73-762722452ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.804547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38018a-0430-4e3c-8c73-762722452ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.804831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38018a-0430-4e3c-8c73-762722452ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.805104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38018a-0430-4e3c-8c73-762722452ff9 None admin] PATH_INFO: `/v3/users/45cfbef997ac416e9a5450add3404a63` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.806285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38018a-0430-4e3c-8c73-762722452ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=45cfbef997ac416e9a5450add3404a63)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.807738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38018a-0430-4e3c-8c73-762722452ff9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.809349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 101/195] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/users/45cfbef997ac416e9a5450add3404a63 => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:56.810099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38018a-0430-4e3c-8c73-762722452ff9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.812406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188da5-92a9-4a4a-9198-9807048da33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.813055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188da5-92a9-4a4a-9198-9807048da33d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.813348 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188da5-92a9-4a4a-9198-9807048da33d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.813645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188da5-92a9-4a4a-9198-9807048da33d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.881247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b188da5-92a9-4a4a-9198-9807048da33d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.882709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b188da5-92a9-4a4a-9198-9807048da33d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.907916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38018a-0430-4e3c-8c73-762722452ff9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:56.940010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866225a-199c-407f-b5ea-e03de48adab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:56.940659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866225a-199c-407f-b5ea-e03de48adab9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:56.940947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866225a-199c-407f-b5ea-e03de48adab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:56.941231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866225a-199c-407f-b5ea-e03de48adab9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:56.942063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866225a-199c-407f-b5ea-e03de48adab9 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=a91db3386fe24593821f7424072923f8, user.id=6dac917bcc034de386b578ee9ad980f6) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:56.942378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866225a-199c-407f-b5ea-e03de48adab9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:56.944339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866225a-199c-407f-b5ea-e03de48adab9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:56.950508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 102/196] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/role_assignments?user.id=6dac917bcc034de386b578ee9ad980f6&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=c6577847f998435991dac5744a94d0ee => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:56.951105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866225a-199c-407f-b5ea-e03de48adab9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:56.964286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:56.990035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 95/197] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:56.990896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188da5-92a9-4a4a-9198-9807048da33d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:57.034869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:57.079587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866225a-199c-407f-b5ea-e03de48adab9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:57.108760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188da5-92a9-4a4a-9198-9807048da33d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:57.119550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b79158-efa7-4fd7-862b-58e2031b0ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:57.120571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b79158-efa7-4fd7-862b-58e2031b0ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:57.120864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b79158-efa7-4fd7-862b-58e2031b0ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:57.121323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b79158-efa7-4fd7-862b-58e2031b0ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:57.122094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b79158-efa7-4fd7-862b-58e2031b0ea3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:57.122408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b79158-efa7-4fd7-862b-58e2031b0ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:57.124015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b79158-efa7-4fd7-862b-58e2031b0ea3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:57.134336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 103/198] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:07:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:57.135594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b79158-efa7-4fd7-862b-58e2031b0ea3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:57.152671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b9443-b4ea-422c-b240-8cd3fb00a1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:57.153359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b9443-b4ea-422c-b240-8cd3fb00a1b4 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:57.154863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b9443-b4ea-422c-b240-8cd3fb00a1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:57.154863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b9443-b4ea-422c-b240-8cd3fb00a1b4 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:57.154863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b9443-b4ea-422c-b240-8cd3fb00a1b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:57.156231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b9443-b4ea-422c-b240-8cd3fb00a1b4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:57.180615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 96/199] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:07:56 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:07:57.181439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b9443-b4ea-422c-b240-8cd3fb00a1b4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:57.246597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:57.273519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b79158-efa7-4fd7-862b-58e2031b0ea3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:57.305443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:57.316178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d4a2-b617-4f3f-8531-0745016a9820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:57.316750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d4a2-b617-4f3f-8531-0745016a9820 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:57.317039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d4a2-b617-4f3f-8531-0745016a9820 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:57.317326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d4a2-b617-4f3f-8531-0745016a9820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:57.326360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b9443-b4ea-422c-b240-8cd3fb00a1b4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:57.363763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb76312-3e77-4939-978f-55ba927e7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:57.365104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb76312-3e77-4939-978f-55ba927e7916 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:57.365392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb76312-3e77-4939-978f-55ba927e7916 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:57.365669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb76312-3e77-4939-978f-55ba927e7916 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:57.366954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb76312-3e77-4939-978f-55ba927e7916 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:57.368455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb76312-3e77-4939-978f-55ba927e7916 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:57.370229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 97/200] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:57 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:57.371023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb76312-3e77-4939-978f-55ba927e7916 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:57.405142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3d4a2-b617-4f3f-8531-0745016a9820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:57.406606 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3d4a2-b617-4f3f-8531-0745016a9820 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:57.494645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb76312-3e77-4939-978f-55ba927e7916 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:57.497789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:57.540645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 104/201] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:57.541612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d4a2-b617-4f3f-8531-0745016a9820 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:57.541793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193e033-5bd1-4349-91ab-90a58ce82824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:57.542839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e033-5bd1-4349-91ab-90a58ce82824 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:57.543180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e033-5bd1-4349-91ab-90a58ce82824 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:57.547563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e033-5bd1-4349-91ab-90a58ce82824 None admin] PATH_INFO: `/v3/users/1cf5338b44b24b73923a286bc46d2ec9` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:57.547563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193e033-5bd1-4349-91ab-90a58ce82824 None admin] RBAC: Authorizing `identity:get_user(user_id=1cf5338b44b24b73923a286bc46d2ec9)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:57.550059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193e033-5bd1-4349-91ab-90a58ce82824 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:57.553695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 98/202] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:07:57 2022] GET /identity/v3/users/1cf5338b44b24b73923a286bc46d2ec9 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:57.555219 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193e033-5bd1-4349-91ab-90a58ce82824 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:57.580929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:57.664617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d4a2-b617-4f3f-8531-0745016a9820 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:57.674303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193e033-5bd1-4349-91ab-90a58ce82824 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:57.701986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0a29a-553d-4f6a-b920-070a7cc34a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:57.702745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0a29a-553d-4f6a-b920-070a7cc34a12 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:57.703029 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0a29a-553d-4f6a-b920-070a7cc34a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:57.703457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0a29a-553d-4f6a-b920-070a7cc34a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:57.704292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0a29a-553d-4f6a-b920-070a7cc34a12 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=309bfab87fbe44008938ccbd283fd590, user.id=1cf5338b44b24b73923a286bc46d2ec9) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:57.704599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0a29a-553d-4f6a-b920-070a7cc34a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:57.706174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0a29a-553d-4f6a-b920-070a7cc34a12 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:57.711484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfb438-f7e3-4d41-89a4-344f8ddbb67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:57.712488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 105/203] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:57 2022] GET /identity/v3/role_assignments?user.id=1cf5338b44b24b73923a286bc46d2ec9&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=c6577847f998435991dac5744a94d0ee => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:57.712603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfb438-f7e3-4d41-89a4-344f8ddbb67b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:57.712603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfb438-f7e3-4d41-89a4-344f8ddbb67b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:57.712893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfb438-f7e3-4d41-89a4-344f8ddbb67b None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:57.713074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0a29a-553d-4f6a-b920-070a7cc34a12 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:57.714155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfb438-f7e3-4d41-89a4-344f8ddbb67b None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:57.715790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfb438-f7e3-4d41-89a4-344f8ddbb67b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:57.718027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 99/204] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:57 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:57.728381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfb438-f7e3-4d41-89a4-344f8ddbb67b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:57.824774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:57.832994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0a29a-553d-4f6a-b920-070a7cc34a12 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:57.850323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:57.906893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068dbe3-5cad-423b-831d-d6099eadbd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:57.907592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068dbe3-5cad-423b-831d-d6099eadbd61 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:57.907871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068dbe3-5cad-423b-831d-d6099eadbd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:57.908141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068dbe3-5cad-423b-831d-d6099eadbd61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:57.959835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfb438-f7e3-4d41-89a4-344f8ddbb67b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:57.994479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068dbe3-5cad-423b-831d-d6099eadbd61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:57.996421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068dbe3-5cad-423b-831d-d6099eadbd61 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:58.001552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9145c-babd-4bb4-9c49-14141fb9de16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:58.002478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9145c-babd-4bb4-9c49-14141fb9de16 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:58.002957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9145c-babd-4bb4-9c49-14141fb9de16 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:58.003463 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9145c-babd-4bb4-9c49-14141fb9de16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:58.004526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9145c-babd-4bb4-9c49-14141fb9de16 None admin] RBAC: Adding query filter params (role.id=aa51c41209054701acd2b9e3bbe58114, scope.project.id=a91db3386fe24593821f7424072923f8, user.id=45cfbef997ac416e9a5450add3404a63) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:58.005072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9145c-babd-4bb4-9c49-14141fb9de16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:58.006715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9145c-babd-4bb4-9c49-14141fb9de16 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:58.014068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 100/205] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:57 2022] GET /identity/v3/role_assignments?user.id=45cfbef997ac416e9a5450add3404a63&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=aa51c41209054701acd2b9e3bbe58114 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:58.142773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:58.158588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 106/206] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:07:58.165149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9145c-babd-4bb4-9c49-14141fb9de16 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:58.322555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9145c-babd-4bb4-9c49-14141fb9de16 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:58.324449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:58.361277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a10af-330b-4722-b03a-d0765b90b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:58.362152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a10af-330b-4722-b03a-d0765b90b345 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:58.362438 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a10af-330b-4722-b03a-d0765b90b345 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:58.362715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a10af-330b-4722-b03a-d0765b90b345 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:58.364074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a10af-330b-4722-b03a-d0765b90b345 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:58.365588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a10af-330b-4722-b03a-d0765b90b345 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:58.367632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 101/207] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:07:58 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:58.376413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068dbe3-5cad-423b-831d-d6099eadbd61 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:58.504481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068dbe3-5cad-423b-831d-d6099eadbd61 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:07:58.545638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56d0c8-33f7-4423-8fc7-54a148cbf0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:07:58.546306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d0c8-33f7-4423-8fc7-54a148cbf0ca None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:58.546592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d0c8-33f7-4423-8fc7-54a148cbf0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:58.546870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d0c8-33f7-4423-8fc7-54a148cbf0ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:58.547776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d0c8-33f7-4423-8fc7-54a148cbf0ca None admin] RBAC: Adding query filter params (role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=309bfab87fbe44008938ccbd283fd590, user.id=1cf5338b44b24b73923a286bc46d2ec9) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:07:58.548090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d0c8-33f7-4423-8fc7-54a148cbf0ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:07:58.549549 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d0c8-33f7-4423-8fc7-54a148cbf0ca None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:07:58.563520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 107/208] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:07:58 2022] GET /identity/v3/role_assignments?user.id=1cf5338b44b24b73923a286bc46d2ec9&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:07:59.725817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9143a-bb78-4fd5-9271-fd5f6153884d None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:59.726860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9143a-bb78-4fd5-9271-fd5f6153884d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:59.727372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9143a-bb78-4fd5-9271-fd5f6153884d None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:59.729232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 102/209] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:07:59.734783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968ceb5-35ad-44b1-8324-2de311999315 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:59.735661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968ceb5-35ad-44b1-8324-2de311999315 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:59.736169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968ceb5-35ad-44b1-8324-2de311999315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:59.753413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e968ceb5-35ad-44b1-8324-2de311999315 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:59.754955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e968ceb5-35ad-44b1-8324-2de311999315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:59.771274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb709771-42bc-4a56-909c-b9d3e0bf7bef None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:59.771724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb709771-42bc-4a56-909c-b9d3e0bf7bef None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:59.772223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb709771-42bc-4a56-909c-b9d3e0bf7bef None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:59.774020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 103/210] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:07:59.780126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081ac3-7390-4532-80b0-db12de962f7b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:07:59.780421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081ac3-7390-4532-80b0-db12de962f7b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:07:59.780899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081ac3-7390-4532-80b0-db12de962f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:07:59.801519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-bd081ac3-7390-4532-80b0-db12de962f7b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:07:59.803118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-bd081ac3-7390-4532-80b0-db12de962f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:07:59.815390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:07:59.836858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 108/211] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:59.860389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968ceb5-35ad-44b1-8324-2de311999315 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:59.898885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 104/212] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:07:59.923314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081ac3-7390-4532-80b0-db12de962f7b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:07:59.967138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968ceb5-35ad-44b1-8324-2de311999315 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:00.003935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12a047-a5a2-4847-a0ae-a920f0b46916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:00.005458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12a047-a5a2-4847-a0ae-a920f0b46916 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.005889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12a047-a5a2-4847-a0ae-a920f0b46916 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.006406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12a047-a5a2-4847-a0ae-a920f0b46916 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.018103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12a047-a5a2-4847-a0ae-a920f0b46916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-af12a047-a5a2-4847-a0ae-a920f0b46916 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:00.027112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:00.028168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:00.029053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:00.031211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 109/213] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:07:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:00.037107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12a047-a5a2-4847-a0ae-a920f0b46916 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:00.044838 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081ac3-7390-4532-80b0-db12de962f7b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:00.047679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:00.088870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:00.090231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8769d-f07f-432e-874d-4f13aa1228d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:00.091752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8769d-f07f-432e-874d-4f13aa1228d1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.092743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8769d-f07f-432e-874d-4f13aa1228d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.093169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8769d-f07f-432e-874d-4f13aa1228d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.095394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8769d-f07f-432e-874d-4f13aa1228d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:00.096908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8769d-f07f-432e-874d-4f13aa1228d1 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:00.103486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 105/214] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:07:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:00.103996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8769d-f07f-432e-874d-4f13aa1228d1 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:00.158260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12a047-a5a2-4847-a0ae-a920f0b46916 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:00.198294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7fde6-f9e0-4d6b-9375-9db66e8d51bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:00.199081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7fde6-f9e0-4d6b-9375-9db66e8d51bd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.199394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7fde6-f9e0-4d6b-9375-9db66e8d51bd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.199716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7fde6-f9e0-4d6b-9375-9db66e8d51bd None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.200479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7fde6-f9e0-4d6b-9375-9db66e8d51bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:00.200789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7fde6-f9e0-4d6b-9375-9db66e8d51bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:00.202173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7fde6-f9e0-4d6b-9375-9db66e8d51bd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:00.210532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 110/215] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:00.213260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8baf3-1843-486a-81c2-30a467924a7f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.213981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8baf3-1843-486a-81c2-30a467924a7f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.214463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8baf3-1843-486a-81c2-30a467924a7f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.216665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 111/216] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:00.220708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8baf3-1843-486a-81c2-30a467924a7f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:00.238479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8769d-f07f-432e-874d-4f13aa1228d1 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:00.273290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66ea7e-a3b1-4043-9e66-cfaf43d70565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:00.273890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66ea7e-a3b1-4043-9e66-cfaf43d70565 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.274176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66ea7e-a3b1-4043-9e66-cfaf43d70565 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.274454 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66ea7e-a3b1-4043-9e66-cfaf43d70565 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.275174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66ea7e-a3b1-4043-9e66-cfaf43d70565 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:00.276704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66ea7e-a3b1-4043-9e66-cfaf43d70565 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:00.298672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 106/217] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:08:00 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:08:00.299843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507421-8bf1-4a3e-8c99-783100d02780 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.300136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507421-8bf1-4a3e-8c99-783100d02780 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.300722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0507421-8bf1-4a3e-8c99-783100d02780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.319605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a0507421-8bf1-4a3e-8c99-783100d02780 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:00.321256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a0507421-8bf1-4a3e-8c99-783100d02780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:00.342209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8baf3-1843-486a-81c2-30a467924a7f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:00.350720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:00.351375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:00.384720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cb7f4-a707-4104-969c-d4b99a2cf6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:00.385925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cb7f4-a707-4104-969c-d4b99a2cf6fb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.386381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cb7f4-a707-4104-969c-d4b99a2cf6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.386800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cb7f4-a707-4104-969c-d4b99a2cf6fb None admin] PATH_INFO: `/v3/users/348faa0673704e08a5d4b297e2027fea` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.402794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cb7f4-a707-4104-969c-d4b99a2cf6fb None admin] RBAC: Authorizing `identity:get_user(user_id=348faa0673704e08a5d4b297e2027fea)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:00.410343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 107/218] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:00.410534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cb7f4-a707-4104-969c-d4b99a2cf6fb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:00.415072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507421-8bf1-4a3e-8c99-783100d02780 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:00.415528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 112/219] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:00 2022] GET /identity/v3/users/348faa0673704e08a5d4b297e2027fea => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:00.429052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cb7f4-a707-4104-969c-d4b99a2cf6fb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:00.556310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cb7f4-a707-4104-969c-d4b99a2cf6fb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:00.556610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0507421-8bf1-4a3e-8c99-783100d02780 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:00.596655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bbcf8-f074-4e0e-8d47-b9b4df60c2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:00.597366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f4afc-1b34-479a-92f6-ace9ccb9e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:00.597826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bbcf8-f074-4e0e-8d47-b9b4df60c2cf None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.598208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f4afc-1b34-479a-92f6-ace9ccb9e1fb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.598373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bbcf8-f074-4e0e-8d47-b9b4df60c2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.599176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f4afc-1b34-479a-92f6-ace9ccb9e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.599471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bbcf8-f074-4e0e-8d47-b9b4df60c2cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.599626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f4afc-1b34-479a-92f6-ace9ccb9e1fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.611298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bbcf8-f074-4e0e-8d47-b9b4df60c2cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-874bbcf8-f074-4e0e-8d47-b9b4df60c2cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:00.621462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:00.622377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:00.623176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:00.625266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 113/220] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:00.628807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:00.631545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bbcf8-f074-4e0e-8d47-b9b4df60c2cf None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:00.662596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:00.686359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f4afc-1b34-479a-92f6-ace9ccb9e1fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:00.688096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f4afc-1b34-479a-92f6-ace9ccb9e1fb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:00.753312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bbcf8-f074-4e0e-8d47-b9b4df60c2cf None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:00.790030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef407-e4b1-4b25-9153-5af201aac2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:00.790950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef407-e4b1-4b25-9153-5af201aac2da None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.791515 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef407-e4b1-4b25-9153-5af201aac2da None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.792018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef407-e4b1-4b25-9153-5af201aac2da None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.792980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef407-e4b1-4b25-9153-5af201aac2da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:00.793489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef407-e4b1-4b25-9153-5af201aac2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:00.795065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef407-e4b1-4b25-9153-5af201aac2da None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:00.804744 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 114/221] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:00.812442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef407-e4b1-4b25-9153-5af201aac2da None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:00.821264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 108/222] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:08:00.827583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f4afc-1b34-479a-92f6-ace9ccb9e1fb None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:00.896756 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:00.939928 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f4afc-1b34-479a-92f6-ace9ccb9e1fb None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:00.983176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0902c2-3512-477f-a03c-551e47b648c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:00.984855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0902c2-3512-477f-a03c-551e47b648c9 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:00.985296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0902c2-3512-477f-a03c-551e47b648c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:00.985726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0902c2-3512-477f-a03c-551e47b648c9 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:00.988032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0902c2-3512-477f-a03c-551e47b648c9 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:00.989960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0902c2-3512-477f-a03c-551e47b648c9 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:00.993172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 109/223] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:00 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:00.999744 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:01.000293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc322bb-85e4-496b-9de3-9b2a29a0b6c4 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:01.000728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc322bb-85e4-496b-9de3-9b2a29a0b6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:01.001177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc322bb-85e4-496b-9de3-9b2a29a0b6c4 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:01.003985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 110/224] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:01.004898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc322bb-85e4-496b-9de3-9b2a29a0b6c4 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:01.022209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef407-e4b1-4b25-9153-5af201aac2da None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:01.066492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040413f-2560-410f-8a52-27f8ce53aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:01.067804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040413f-2560-410f-8a52-27f8ce53aacc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:01.068814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040413f-2560-410f-8a52-27f8ce53aacc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:01.069756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040413f-2560-410f-8a52-27f8ce53aacc None admin] PATH_INFO: `/v3/users/1cf5338b44b24b73923a286bc46d2ec9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:01.071181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040413f-2560-410f-8a52-27f8ce53aacc None admin] RBAC: Authorizing `identity:get_user(user_id=1cf5338b44b24b73923a286bc46d2ec9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:01.074117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040413f-2560-410f-8a52-27f8ce53aacc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:01.080295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 115/225] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:00 2022] GET /identity/v3/users/1cf5338b44b24b73923a286bc46d2ec9 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:01.081607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5a241-94aa-4b65-9944-3301e22898e2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:01.082064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5a241-94aa-4b65-9944-3301e22898e2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:01.082495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5a241-94aa-4b65-9944-3301e22898e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:01.101124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-22e5a241-94aa-4b65-9944-3301e22898e2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:01.102568 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-22e5a241-94aa-4b65-9944-3301e22898e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:01.131321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc322bb-85e4-496b-9de3-9b2a29a0b6c4 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:01.160009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:01.173977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501eb6c0-1478-4f3a-89f8-f8af384a21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:01.174833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eb6c0-1478-4f3a-89f8-f8af384a21b3 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:01.175283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eb6c0-1478-4f3a-89f8-f8af384a21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:01.175719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501eb6c0-1478-4f3a-89f8-f8af384a21b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:01.176742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501eb6c0-1478-4f3a-89f8-f8af384a21b3 None admin] RBAC: Adding query filter params (role.id=a284a48d48b2440997815469786a10ec, scope.project.id=309bfab87fbe44008938ccbd283fd590, user.id=348faa0673704e08a5d4b297e2027fea) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:01.177238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501eb6c0-1478-4f3a-89f8-f8af384a21b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:01.178846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501eb6c0-1478-4f3a-89f8-f8af384a21b3 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:01.184552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 116/226] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:01.191487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5a241-94aa-4b65-9944-3301e22898e2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:01.192464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 111/227] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:01 2022] GET /identity/v3/role_assignments?user.id=348faa0673704e08a5d4b297e2027fea&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=a284a48d48b2440997815469786a10ec => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:01.209686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501eb6c0-1478-4f3a-89f8-f8af384a21b3 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:01.343003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:01.363658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5a241-94aa-4b65-9944-3301e22898e2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:01.405992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a940b0-d276-408e-892f-785441d7c8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:01.407249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a940b0-d276-408e-892f-785441d7c8cb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:01.407946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a940b0-d276-408e-892f-785441d7c8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:01.408423 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a940b0-d276-408e-892f-785441d7c8cb None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:01.410269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a940b0-d276-408e-892f-785441d7c8cb None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:01.413126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a940b0-d276-408e-892f-785441d7c8cb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:01.419460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 117/228] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:01 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:01.422312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a940b0-d276-408e-892f-785441d7c8cb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:01.458426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501eb6c0-1478-4f3a-89f8-f8af384a21b3 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:01.497601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febc68b-bc59-4216-8075-f2e31cacff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:01.498838 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febc68b-bc59-4216-8075-f2e31cacff86 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:01.499319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febc68b-bc59-4216-8075-f2e31cacff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:01.499810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febc68b-bc59-4216-8075-f2e31cacff86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:01.512167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febc68b-bc59-4216-8075-f2e31cacff86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-2febc68b-bc59-4216-8075-f2e31cacff86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:01.521056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:01.521932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:01.522721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:01.530080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 112/229] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:08:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:01.534149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febc68b-bc59-4216-8075-f2e31cacff86 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:01.545992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a940b0-d276-408e-892f-785441d7c8cb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:01.587018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6b6a-6aaa-4b8b-8fab-02897b50d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:01.588268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6b6a-6aaa-4b8b-8fab-02897b50d5b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:01.590663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6b6a-6aaa-4b8b-8fab-02897b50d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:01.591824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e6b6a-6aaa-4b8b-8fab-02897b50d5b1 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590/users/1cf5338b44b24b73923a286bc46d2ec9/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:01.602271 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e6b6a-6aaa-4b8b-8fab-02897b50d5b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=309bfab87fbe44008938ccbd283fd590, user_id=1cf5338b44b24b73923a286bc46d2ec9, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:01.608501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e6b6a-6aaa-4b8b-8fab-02897b50d5b1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:01.632976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 118/230] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:08:01 2022] PUT /identity/v3/projects/309bfab87fbe44008938ccbd283fd590/users/1cf5338b44b24b73923a286bc46d2ec9/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:08:01.634632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:01.697546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febc68b-bc59-4216-8075-f2e31cacff86 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:01.735373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29560b-5b77-47d1-a579-44f6db972c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:01.736519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29560b-5b77-47d1-a579-44f6db972c11 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:01.737008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29560b-5b77-47d1-a579-44f6db972c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:01.737513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29560b-5b77-47d1-a579-44f6db972c11 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:01.738487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29560b-5b77-47d1-a579-44f6db972c11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:01.739013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29560b-5b77-47d1-a579-44f6db972c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:01.740683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29560b-5b77-47d1-a579-44f6db972c11 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:01.750427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 113/231] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:01.756629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6b6a-6aaa-4b8b-8fab-02897b50d5b1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:01.775892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:01.885535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e6b6a-6aaa-4b8b-8fab-02897b50d5b1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:01.931617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946654c-ac18-4c78-8789-3a929a6e772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:01.932516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946654c-ac18-4c78-8789-3a929a6e772e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:01.932801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946654c-ac18-4c78-8789-3a929a6e772e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:01.933081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946654c-ac18-4c78-8789-3a929a6e772e None admin] PATH_INFO: `/v3/users/1cf5338b44b24b73923a286bc46d2ec9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:01.936899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946654c-ac18-4c78-8789-3a929a6e772e None admin] RBAC: Authorizing `identity:get_user(user_id=1cf5338b44b24b73923a286bc46d2ec9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:01.938361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946654c-ac18-4c78-8789-3a929a6e772e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:01.940251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 119/232] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:01 2022] GET /identity/v3/users/1cf5338b44b24b73923a286bc46d2ec9 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:01.945801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29560b-5b77-47d1-a579-44f6db972c11 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:02.062182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29560b-5b77-47d1-a579-44f6db972c11 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:02.072208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:02.098383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9e97-9369-4543-9750-8c0344a76503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:02.099296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9e97-9369-4543-9750-8c0344a76503 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:02.099627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9e97-9369-4543-9750-8c0344a76503 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:02.099892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9e97-9369-4543-9750-8c0344a76503 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:02.101106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d9e97-9369-4543-9750-8c0344a76503 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:02.102562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d9e97-9369-4543-9750-8c0344a76503 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:02.106027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 114/233] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:01 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:02.111722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946654c-ac18-4c78-8789-3a929a6e772e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:02.235584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:02.261027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946654c-ac18-4c78-8789-3a929a6e772e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:02.317023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643f5c1-1a06-4bef-af6e-89315616e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:02.318832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643f5c1-1a06-4bef-af6e-89315616e6c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:02.319380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643f5c1-1a06-4bef-af6e-89315616e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:02.319856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643f5c1-1a06-4bef-af6e-89315616e6c9 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590/users/1cf5338b44b24b73923a286bc46d2ec9/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:02.322349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643f5c1-1a06-4bef-af6e-89315616e6c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=309bfab87fbe44008938ccbd283fd590, user_id=1cf5338b44b24b73923a286bc46d2ec9, role_id=8b03cb8cbf3248d1a22cd48ec5c21eb6)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:02.324317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643f5c1-1a06-4bef-af6e-89315616e6c9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:02.350992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 120/234] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:08:02 2022] PUT /identity/v3/projects/309bfab87fbe44008938ccbd283fd590/users/1cf5338b44b24b73923a286bc46d2ec9/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:03.122304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2029a-e376-43f8-aad7-da79a0a9bfc6 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.122829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2029a-e376-43f8-aad7-da79a0a9bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.122938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2029a-e376-43f8-aad7-da79a0a9bfc6 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:03.124540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 115/235] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:03.130541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05a63c-2eec-4af6-b94f-f347af61234d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.130953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05a63c-2eec-4af6-b94f-f347af61234d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.131127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05a63c-2eec-4af6-b94f-f347af61234d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:03.148621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ac05a63c-2eec-4af6-b94f-f347af61234d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:03.149840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ac05a63c-2eec-4af6-b94f-f347af61234d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:03.246854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 121/236] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:03.258319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bab2c-1756-4801-987e-2cbfe5f6d10c None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.258601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bab2c-1756-4801-987e-2cbfe5f6d10c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.258887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bab2c-1756-4801-987e-2cbfe5f6d10c None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:03.260293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 116/237] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:03.265858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0930b6-75e3-4170-bd5f-64456627de13 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.266152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0930b6-75e3-4170-bd5f-64456627de13 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.266434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0930b6-75e3-4170-bd5f-64456627de13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:03.281595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bab2c-1756-4801-987e-2cbfe5f6d10c None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:03.287219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0f0930b6-75e3-4170-bd5f-64456627de13 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:03.288442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0f0930b6-75e3-4170-bd5f-64456627de13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:03.403399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:03.416436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 122/238] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:03.449770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bab2c-1756-4801-987e-2cbfe5f6d10c None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:03.451304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0930b6-75e3-4170-bd5f-64456627de13 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:03.531645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f0d3-572c-4f32-a291-6e1af7d42f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:03.532810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f0d3-572c-4f32-a291-6e1af7d42f16 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.533295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f0d3-572c-4f32-a291-6e1af7d42f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.533788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f0d3-572c-4f32-a291-6e1af7d42f16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:03.535374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2f0d3-572c-4f32-a291-6e1af7d42f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:03.538730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2f0d3-572c-4f32-a291-6e1af7d42f16 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:03.544300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 117/239] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:03.549224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f0d3-572c-4f32-a291-6e1af7d42f16 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:03.638794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0930b6-75e3-4170-bd5f-64456627de13 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:03.650052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:03.715586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f0d3-572c-4f32-a291-6e1af7d42f16 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:03.735870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385f077-f2a0-4f8e-9a36-6dcf69b19386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:03.737783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385f077-f2a0-4f8e-9a36-6dcf69b19386 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.741541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385f077-f2a0-4f8e-9a36-6dcf69b19386 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.742057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385f077-f2a0-4f8e-9a36-6dcf69b19386 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:03.761249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385f077-f2a0-4f8e-9a36-6dcf69b19386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-c385f077-f2a0-4f8e-9a36-6dcf69b19386 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:03.769987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:03.770904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:03.771754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:03.777106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8779-5cbb-4f2e-9e05-2164296a569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:03.777962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8779-5cbb-4f2e-9e05-2164296a569d None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.778392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8779-5cbb-4f2e-9e05-2164296a569d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.778813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8779-5cbb-4f2e-9e05-2164296a569d None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:03.779711 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e8779-5cbb-4f2e-9e05-2164296a569d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:03.781291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e8779-5cbb-4f2e-9e05-2164296a569d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:03.787912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 123/240] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:03.793474 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385f077-f2a0-4f8e-9a36-6dcf69b19386 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:03.809953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 118/241] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:08:03 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:08:03.871994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:03.917402 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385f077-f2a0-4f8e-9a36-6dcf69b19386 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:03.954855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a7a4e-cb28-4c5c-af14-d647214e4c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:03.956008 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7a4e-cb28-4c5c-af14-d647214e4c01 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.956438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7a4e-cb28-4c5c-af14-d647214e4c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.956902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a7a4e-cb28-4c5c-af14-d647214e4c01 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:03.958351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a7a4e-cb28-4c5c-af14-d647214e4c01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:03.958849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a7a4e-cb28-4c5c-af14-d647214e4c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:03.960428 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a7a4e-cb28-4c5c-af14-d647214e4c01 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:03.970431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 124/242] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:03.976193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8779-5cbb-4f2e-9e05-2164296a569d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:03.981408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaafe8-69b2-48c3-92d9-a1ebd2f77835 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.981703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaafe8-69b2-48c3-92d9-a1ebd2f77835 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.981985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaafe8-69b2-48c3-92d9-a1ebd2f77835 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:03.983643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 125/243] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:03.990752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b59af-e58f-4c3e-94b5-3df1fb221c5f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:03.990752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b59af-e58f-4c3e-94b5-3df1fb221c5f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:03.990752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b59af-e58f-4c3e-94b5-3df1fb221c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:04.016703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d74b59af-e58f-4c3e-94b5-3df1fb221c5f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:04.022194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d74b59af-e58f-4c3e-94b5-3df1fb221c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:04.127433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 126/244] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:04.156912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b59af-e58f-4c3e-94b5-3df1fb221c5f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:04.174352 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:04.178507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8779-5cbb-4f2e-9e05-2164296a569d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:04.224372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:04.224540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164361e-4bd3-4739-adcd-e970148d4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:04.225806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164361e-4bd3-4739-adcd-e970148d4b6a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:04.226162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164361e-4bd3-4739-adcd-e970148d4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:04.226633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164361e-4bd3-4739-adcd-e970148d4b6a None admin] PATH_INFO: `/v3/users/7e5d64bc3fd64cf48231c550e6c7c734` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:04.247931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164361e-4bd3-4739-adcd-e970148d4b6a None admin] RBAC: Authorizing `identity:get_user(user_id=7e5d64bc3fd64cf48231c550e6c7c734)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:04.249696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164361e-4bd3-4739-adcd-e970148d4b6a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:04.251758 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 119/245] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:03 2022] GET /identity/v3/users/7e5d64bc3fd64cf48231c550e6c7c734 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:04.257227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164361e-4bd3-4739-adcd-e970148d4b6a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:04.274377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b59af-e58f-4c3e-94b5-3df1fb221c5f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:04.313678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32311af-0bfb-46ca-82e4-ef707a3cd3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:04.314482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32311af-0bfb-46ca-82e4-ef707a3cd3fe None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:04.314763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32311af-0bfb-46ca-82e4-ef707a3cd3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:04.315037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32311af-0bfb-46ca-82e4-ef707a3cd3fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:04.327446 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32311af-0bfb-46ca-82e4-ef707a3cd3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d32311af-0bfb-46ca-82e4-ef707a3cd3fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:04.336109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:04.337018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:04.337914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 127/246] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:04.343326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32311af-0bfb-46ca-82e4-ef707a3cd3fe None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:04.381317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164361e-4bd3-4739-adcd-e970148d4b6a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:04.427042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10442b18-47f4-44d8-9a74-90711e4d2a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:04.428096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10442b18-47f4-44d8-9a74-90711e4d2a92 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:04.428701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10442b18-47f4-44d8-9a74-90711e4d2a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:04.429187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10442b18-47f4-44d8-9a74-90711e4d2a92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:04.453748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32311af-0bfb-46ca-82e4-ef707a3cd3fe None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:04.464806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:04.468045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:04.506340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c10e3e-1268-481e-a1b9-2e53c5b08922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:04.507023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10e3e-1268-481e-a1b9-2e53c5b08922 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:04.507307 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10e3e-1268-481e-a1b9-2e53c5b08922 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:04.507615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c10e3e-1268-481e-a1b9-2e53c5b08922 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:04.508386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c10e3e-1268-481e-a1b9-2e53c5b08922 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:04.508697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c10e3e-1268-481e-a1b9-2e53c5b08922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:04.510166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c10e3e-1268-481e-a1b9-2e53c5b08922 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:04.523230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 128/247] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:04.524940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d104ed-a625-481c-bfd5-9877a355b3fe None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:04.525415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d104ed-a625-481c-bfd5-9877a355b3fe None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:04.525871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d104ed-a625-481c-bfd5-9877a355b3fe None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:04.527552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 129/248] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:04.530651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d104ed-a625-481c-bfd5-9877a355b3fe None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:04.531886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10442b18-47f4-44d8-9a74-90711e4d2a92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:04.533432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10442b18-47f4-44d8-9a74-90711e4d2a92 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:04.650691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d104ed-a625-481c-bfd5-9877a355b3fe None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:04.652736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 120/249] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:08:04.654158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3653-c45a-4ff7-bc7f-f3411a5cd0b1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:04.654453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3653-c45a-4ff7-bc7f-f3411a5cd0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:04.654728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3653-c45a-4ff7-bc7f-f3411a5cd0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:04.670604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-297f3653-c45a-4ff7-bc7f-f3411a5cd0b1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:04.671826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-297f3653-c45a-4ff7-bc7f-f3411a5cd0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:04.697516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96fd64-a2c6-4e27-ab30-f35228861a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:04.698699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96fd64-a2c6-4e27-ab30-f35228861a6b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:04.698985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96fd64-a2c6-4e27-ab30-f35228861a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:04.699263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96fd64-a2c6-4e27-ab30-f35228861a6b None admin] PATH_INFO: `/v3/users/348faa0673704e08a5d4b297e2027fea` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:04.703119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96fd64-a2c6-4e27-ab30-f35228861a6b None admin] RBAC: Authorizing `identity:get_user(user_id=348faa0673704e08a5d4b297e2027fea)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:04.706897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96fd64-a2c6-4e27-ab30-f35228861a6b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:04.709443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 130/250] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:04 2022] GET /identity/v3/users/348faa0673704e08a5d4b297e2027fea => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:04.717086 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96fd64-a2c6-4e27-ab30-f35228861a6b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:04.788970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:04.790345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:04.817970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 121/251] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:04.818830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f3653-c45a-4ff7-bc7f-f3411a5cd0b1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:04.865172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96fd64-a2c6-4e27-ab30-f35228861a6b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:04.900591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15745bca-580d-4d59-af34-297342669deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:04.901472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15745bca-580d-4d59-af34-297342669deb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:04.901758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15745bca-580d-4d59-af34-297342669deb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:04.902034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15745bca-580d-4d59-af34-297342669deb None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:04.903255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15745bca-580d-4d59-af34-297342669deb None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:04.904893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15745bca-580d-4d59-af34-297342669deb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:04.906822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 131/252] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:04 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:04.907475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15745bca-580d-4d59-af34-297342669deb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:05.012553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15745bca-580d-4d59-af34-297342669deb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:05.023670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:05.049199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26199a-b484-44e9-8c45-fc4faf55f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:05.049950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26199a-b484-44e9-8c45-fc4faf55f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:05.050241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26199a-b484-44e9-8c45-fc4faf55f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:05.050525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26199a-b484-44e9-8c45-fc4faf55f1e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:05.057284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f3653-c45a-4ff7-bc7f-f3411a5cd0b1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:05.062290 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26199a-b484-44e9-8c45-fc4faf55f1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-eb26199a-b484-44e9-8c45-fc4faf55f1e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:05.071023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:05.071946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:05.072746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 132/253] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:05.073668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26199a-b484-44e9-8c45-fc4faf55f1e2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:05.180591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51152c0c-ab37-4613-ac4b-e3498c8dcc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:05.181475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51152c0c-ab37-4613-ac4b-e3498c8dcc89 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:05.181760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51152c0c-ab37-4613-ac4b-e3498c8dcc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:05.182036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51152c0c-ab37-4613-ac4b-e3498c8dcc89 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:05.188065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51152c0c-ab37-4613-ac4b-e3498c8dcc89 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:05.189539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51152c0c-ab37-4613-ac4b-e3498c8dcc89 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:05.190249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26199a-b484-44e9-8c45-fc4faf55f1e2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:05.191601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 122/254] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:04 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:05.192421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51152c0c-ab37-4613-ac4b-e3498c8dcc89 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:05.236828 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44583300-49bb-4d45-8d4c-d1f74915ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:05.237522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44583300-49bb-4d45-8d4c-d1f74915ff7f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:05.237841 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44583300-49bb-4d45-8d4c-d1f74915ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:05.238162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44583300-49bb-4d45-8d4c-d1f74915ff7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:05.239098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44583300-49bb-4d45-8d4c-d1f74915ff7f None admin] RBAC: Adding query filter params (role.id=aa51c41209054701acd2b9e3bbe58114, scope.project.id=309bfab87fbe44008938ccbd283fd590, user.id=7e5d64bc3fd64cf48231c550e6c7c734) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:05.239908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44583300-49bb-4d45-8d4c-d1f74915ff7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:05.241376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44583300-49bb-4d45-8d4c-d1f74915ff7f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:05.249331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 133/255] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:05 2022] GET /identity/v3/role_assignments?user.id=7e5d64bc3fd64cf48231c550e6c7c734&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=aa51c41209054701acd2b9e3bbe58114 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:05.250477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44583300-49bb-4d45-8d4c-d1f74915ff7f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:05.333724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:05.337606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:05.414480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44583300-49bb-4d45-8d4c-d1f74915ff7f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:05.420388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51152c0c-ab37-4613-ac4b-e3498c8dcc89 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:05.452840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f25d20-fbaf-414f-aa5c-ac7da2e9bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:05.454127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25d20-fbaf-414f-aa5c-ac7da2e9bb3a None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:05.454647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25d20-fbaf-414f-aa5c-ac7da2e9bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:05.455141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f25d20-fbaf-414f-aa5c-ac7da2e9bb3a None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590/users/348faa0673704e08a5d4b297e2027fea/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:05.457646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f25d20-fbaf-414f-aa5c-ac7da2e9bb3a None admin] RBAC: Authorizing `identity:create_grant(project_id=309bfab87fbe44008938ccbd283fd590, user_id=348faa0673704e08a5d4b297e2027fea, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:05.460076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f25d20-fbaf-414f-aa5c-ac7da2e9bb3a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:05.475514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 134/256] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:08:05 2022] PUT /identity/v3/projects/309bfab87fbe44008938ccbd283fd590/users/348faa0673704e08a5d4b297e2027fea/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:05.486908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935a5fc-b138-42fa-bc02-b03f205f7023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:05.488220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935a5fc-b138-42fa-bc02-b03f205f7023 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:05.488712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935a5fc-b138-42fa-bc02-b03f205f7023 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:05.489272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935a5fc-b138-42fa-bc02-b03f205f7023 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:05.490446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935a5fc-b138-42fa-bc02-b03f205f7023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:05.491078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935a5fc-b138-42fa-bc02-b03f205f7023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:05.492940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935a5fc-b138-42fa-bc02-b03f205f7023 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:05.504250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 123/257] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:05.512317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f25d20-fbaf-414f-aa5c-ac7da2e9bb3a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:05.579353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd22f6-4e35-4999-8b93-795dbadfaf2d None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:05.581257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd22f6-4e35-4999-8b93-795dbadfaf2d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:05.581257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd22f6-4e35-4999-8b93-795dbadfaf2d None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:05.582094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 124/258] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:05.593736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1177c88-2391-4619-bcda-84eb2e25b22f None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:05.594015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1177c88-2391-4619-bcda-84eb2e25b22f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:05.594591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1177c88-2391-4619-bcda-84eb2e25b22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:05.635314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b1177c88-2391-4619-bcda-84eb2e25b22f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:05.638625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b1177c88-2391-4619-bcda-84eb2e25b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:05.690033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:05.702706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f25d20-fbaf-414f-aa5c-ac7da2e9bb3a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:05.759159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 125/259] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:05.765174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ceceb-79f2-4974-9b0d-42849b6abaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:05.766260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ceceb-79f2-4974-9b0d-42849b6abaee None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:05.766614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ceceb-79f2-4974-9b0d-42849b6abaee None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:05.766907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ceceb-79f2-4974-9b0d-42849b6abaee None admin] PATH_INFO: `/v3/users/1cf5338b44b24b73923a286bc46d2ec9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:05.768222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ceceb-79f2-4974-9b0d-42849b6abaee None admin] RBAC: Authorizing `identity:get_user(user_id=1cf5338b44b24b73923a286bc46d2ec9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:05.769746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ceceb-79f2-4974-9b0d-42849b6abaee None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:05.772031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 135/260] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:05 2022] GET /identity/v3/users/1cf5338b44b24b73923a286bc46d2ec9 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:05.777739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1177c88-2391-4619-bcda-84eb2e25b22f None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:05.788449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ceceb-79f2-4974-9b0d-42849b6abaee None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:05.866533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:05.930160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ceceb-79f2-4974-9b0d-42849b6abaee None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:05.945022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1177c88-2391-4619-bcda-84eb2e25b22f None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:05.984465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc202f0-2a80-4d90-9bae-3b72d936f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:05.985138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc202f0-2a80-4d90-9bae-3b72d936f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:05.985426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc202f0-2a80-4d90-9bae-3b72d936f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:05.985707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc202f0-2a80-4d90-9bae-3b72d936f4b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:06.016650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce1794-3cff-4676-b6f5-f3d35e7e66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:06.017831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce1794-3cff-4676-b6f5-f3d35e7e66ad None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:06.018320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce1794-3cff-4676-b6f5-f3d35e7e66ad None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:06.018900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce1794-3cff-4676-b6f5-f3d35e7e66ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:06.048248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce1794-3cff-4676-b6f5-f3d35e7e66ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e8ce1794-3cff-4676-b6f5-f3d35e7e66ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:06.063441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:06.064381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:06.065173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:06.065782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc202f0-2a80-4d90-9bae-3b72d936f4b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:06.065782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc202f0-2a80-4d90-9bae-3b72d936f4b9 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:06.068625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 136/261] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:08:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:06.074678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce1794-3cff-4676-b6f5-f3d35e7e66ad None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:06.114583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:06.122243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:06.172725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 126/262] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:06.178799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc202f0-2a80-4d90-9bae-3b72d936f4b9 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:06.297488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce1794-3cff-4676-b6f5-f3d35e7e66ad None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:06.315933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc202f0-2a80-4d90-9bae-3b72d936f4b9 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:06.352794 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a615b-6dde-4641-bd86-7185cbba8854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:06.353661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a615b-6dde-4641-bd86-7185cbba8854 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:06.353945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a615b-6dde-4641-bd86-7185cbba8854 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:06.354222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a615b-6dde-4641-bd86-7185cbba8854 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:06.355471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a615b-6dde-4641-bd86-7185cbba8854 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:06.356941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a615b-6dde-4641-bd86-7185cbba8854 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:06.358842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 127/263] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:06 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:06.365322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a615b-6dde-4641-bd86-7185cbba8854 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:06.386510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522edeb-9fee-4655-afad-6d3bad32f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:06.387114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522edeb-9fee-4655-afad-6d3bad32f9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:06.387424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522edeb-9fee-4655-afad-6d3bad32f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:06.387704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522edeb-9fee-4655-afad-6d3bad32f9c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:06.388462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522edeb-9fee-4655-afad-6d3bad32f9c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:06.388772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522edeb-9fee-4655-afad-6d3bad32f9c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:06.394672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522edeb-9fee-4655-afad-6d3bad32f9c7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:06.402435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:06.412380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 137/264] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:06.418862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522edeb-9fee-4655-afad-6d3bad32f9c7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:06.519561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a615b-6dde-4641-bd86-7185cbba8854 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:06.557968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de78b-84c2-4846-8746-af1751d9116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:06.558671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de78b-84c2-4846-8746-af1751d9116c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:06.558959 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de78b-84c2-4846-8746-af1751d9116c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:06.559238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de78b-84c2-4846-8746-af1751d9116c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:06.560111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99de78b-84c2-4846-8746-af1751d9116c None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=309bfab87fbe44008938ccbd283fd590, user.id=1cf5338b44b24b73923a286bc46d2ec9) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:06.560429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99de78b-84c2-4846-8746-af1751d9116c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:06.561871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99de78b-84c2-4846-8746-af1751d9116c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:06.569455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 128/265] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:06 2022] GET /identity/v3/role_assignments?user.id=1cf5338b44b24b73923a286bc46d2ec9&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=c6577847f998435991dac5744a94d0ee => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:06.679748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:06.710623 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522edeb-9fee-4655-afad-6d3bad32f9c7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:06.764388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8a228-6099-4b49-aa58-5a9233a6326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:06.765273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a228-6099-4b49-aa58-5a9233a6326e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:06.765553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a228-6099-4b49-aa58-5a9233a6326e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:06.765826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a228-6099-4b49-aa58-5a9233a6326e None admin] PATH_INFO: `/v3/users/1cf5338b44b24b73923a286bc46d2ec9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:06.772127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8a228-6099-4b49-aa58-5a9233a6326e None admin] RBAC: Authorizing `identity:get_user(user_id=1cf5338b44b24b73923a286bc46d2ec9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:06.773609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8a228-6099-4b49-aa58-5a9233a6326e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:06.775734 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 138/266] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:06 2022] GET /identity/v3/users/1cf5338b44b24b73923a286bc46d2ec9 => generated 283 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:06.781072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de78b-84c2-4846-8746-af1751d9116c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:06.900420 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:06.924971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de78b-84c2-4846-8746-af1751d9116c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:06.963354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d77547-b531-466d-a164-32bc0ea03ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:06.963948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77547-b531-466d-a164-32bc0ea03ffc None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:06.964238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77547-b531-466d-a164-32bc0ea03ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:06.964515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77547-b531-466d-a164-32bc0ea03ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:07.038517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d77547-b531-466d-a164-32bc0ea03ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:07.040096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d77547-b531-466d-a164-32bc0ea03ffc None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:07.129775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:07.152558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 129/267] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:07.158089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8a228-6099-4b49-aa58-5a9233a6326e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:07.313720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8a228-6099-4b49-aa58-5a9233a6326e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:07.366022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149dfc0-e33e-44e7-9a6b-d5b21e508626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:07.366902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149dfc0-e33e-44e7-9a6b-d5b21e508626 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:07.367182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149dfc0-e33e-44e7-9a6b-d5b21e508626 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:07.367493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149dfc0-e33e-44e7-9a6b-d5b21e508626 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:07.368776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149dfc0-e33e-44e7-9a6b-d5b21e508626 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:07.370216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149dfc0-e33e-44e7-9a6b-d5b21e508626 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:07.371942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 139/268] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:07 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:07.378016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d77547-b531-466d-a164-32bc0ea03ffc None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:07.459116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af260565-8595-4e1a-b1ef-1afc94244bef None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:07.459765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af260565-8595-4e1a-b1ef-1afc94244bef None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:07.460238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af260565-8595-4e1a-b1ef-1afc94244bef None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:07.461781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 140/269] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:07.467138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d1f2e-43b3-4139-a7ef-15c001b6ae4a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:07.467670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d1f2e-43b3-4139-a7ef-15c001b6ae4a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:07.468166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d1f2e-43b3-4139-a7ef-15c001b6ae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:07.505052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-da8d1f2e-43b3-4139-a7ef-15c001b6ae4a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:07.506248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-da8d1f2e-43b3-4139-a7ef-15c001b6ae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:07.514751 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d77547-b531-466d-a164-32bc0ea03ffc None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:07.547696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:07.554423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0776bb-f00b-4732-a6cd-c7268ab6a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:07.555094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0776bb-f00b-4732-a6cd-c7268ab6a82e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:07.555409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0776bb-f00b-4732-a6cd-c7268ab6a82e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:07.555687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0776bb-f00b-4732-a6cd-c7268ab6a82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:07.556544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0776bb-f00b-4732-a6cd-c7268ab6a82e None admin] RBAC: Adding query filter params (role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=309bfab87fbe44008938ccbd283fd590, user.id=1cf5338b44b24b73923a286bc46d2ec9) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:07.557024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0776bb-f00b-4732-a6cd-c7268ab6a82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:07.558896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0776bb-f00b-4732-a6cd-c7268ab6a82e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:07.565567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 130/270] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:07 2022] GET /identity/v3/role_assignments?user.id=1cf5338b44b24b73923a286bc46d2ec9&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:07.689729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 141/271] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:07.736296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0776bb-f00b-4732-a6cd-c7268ab6a82e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:07.778706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df845f50-f9f6-4dbf-807b-4c915a18101c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:07.779012 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df845f50-f9f6-4dbf-807b-4c915a18101c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:07.779278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df845f50-f9f6-4dbf-807b-4c915a18101c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:07.780926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 142/272] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:07.786658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7c983-849d-45a9-b3b4-2809a6796b46 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:07.786961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7c983-849d-45a9-b3b4-2809a6796b46 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:07.787219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7c983-849d-45a9-b3b4-2809a6796b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:07.799612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:07.821901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a0c7c983-849d-45a9-b3b4-2809a6796b46 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:07.823275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a0c7c983-849d-45a9-b3b4-2809a6796b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:07.873086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0776bb-f00b-4732-a6cd-c7268ab6a82e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:07.913898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 143/273] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:07.918733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea8c1-b4ec-4208-b03a-766d768bb101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:07.919594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea8c1-b4ec-4208-b03a-766d768bb101 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:07.919885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea8c1-b4ec-4208-b03a-766d768bb101 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:07.920165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea8c1-b4ec-4208-b03a-766d768bb101 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:07.923123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ea8c1-b4ec-4208-b03a-766d768bb101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:07.924622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ea8c1-b4ec-4208-b03a-766d768bb101 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:07.926592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 131/274] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:07.932120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7c983-849d-45a9-b3b4-2809a6796b46 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:07.952451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea8c1-b4ec-4208-b03a-766d768bb101 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:08.049880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:08.076886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7c983-849d-45a9-b3b4-2809a6796b46 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:08.088935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea8c1-b4ec-4208-b03a-766d768bb101 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:08.103079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:08.121475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a930c10-c3b6-49e1-ba55-2216e5bae2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:08.122748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a930c10-c3b6-49e1-ba55-2216e5bae2bf None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.123034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a930c10-c3b6-49e1-ba55-2216e5bae2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.123312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a930c10-c3b6-49e1-ba55-2216e5bae2bf None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.124312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a930c10-c3b6-49e1-ba55-2216e5bae2bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:08.125761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a930c10-c3b6-49e1-ba55-2216e5bae2bf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:08.127764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe58a-f49a-46fc-b03d-9a8d5dd9fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:08.128684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe58a-f49a-46fc-b03d-9a8d5dd9fd80 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.129072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe58a-f49a-46fc-b03d-9a8d5dd9fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.129992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe58a-f49a-46fc-b03d-9a8d5dd9fd80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.143464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe58a-f49a-46fc-b03d-9a8d5dd9fd80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:08.152178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 144/275] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:08:07 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-fbcbe58a-f49a-46fc-b03d-9a8d5dd9fd80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:08.153130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:08.154192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:08.155323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:08.156203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 132/276] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:08.165331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a930c10-c3b6-49e1-ba55-2216e5bae2bf None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:08.280003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a930c10-c3b6-49e1-ba55-2216e5bae2bf None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:08.315989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd8a28-051c-4cf9-804b-5616f857567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:08.316695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd8a28-051c-4cf9-804b-5616f857567f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.317457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd8a28-051c-4cf9-804b-5616f857567f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.317741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd8a28-051c-4cf9-804b-5616f857567f None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.318518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd8a28-051c-4cf9-804b-5616f857567f None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:08.318820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd8a28-051c-4cf9-804b-5616f857567f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:08.320257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd8a28-051c-4cf9-804b-5616f857567f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:08.323266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:08.335877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 145/277] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:08.337532 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe58a-f49a-46fc-b03d-9a8d5dd9fd80 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:08.374056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ebd0-41f6-4f51-8b1b-2d18e1a0dacf None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.374056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ebd0-41f6-4f51-8b1b-2d18e1a0dacf None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.374056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403ebd0-41f6-4f51-8b1b-2d18e1a0dacf None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.374056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 146/278] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:08.380678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93ca3-151d-4eb7-afa5-479ba3718dd0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.380973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93ca3-151d-4eb7-afa5-479ba3718dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.381254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93ca3-151d-4eb7-afa5-479ba3718dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.400587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-55a93ca3-151d-4eb7-afa5-479ba3718dd0 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:08.401810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-55a93ca3-151d-4eb7-afa5-479ba3718dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:08.460130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe58a-f49a-46fc-b03d-9a8d5dd9fd80 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:08.487379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 147/279] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:08.497249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0716b-206d-4315-9c38-d535c02db234 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.497537 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0716b-206d-4315-9c38-d535c02db234 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.497938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0716b-206d-4315-9c38-d535c02db234 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.499158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 148/280] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:08.506702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf61cd6-4fbf-41eb-9cd2-8cea49690a17 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.506978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf61cd6-4fbf-41eb-9cd2-8cea49690a17 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.507248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf61cd6-4fbf-41eb-9cd2-8cea49690a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.512511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9cd02-93c5-43e0-bd79-a7eedb4af02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:08.513403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9cd02-93c5-43e0-bd79-a7eedb4af02c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.513689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9cd02-93c5-43e0-bd79-a7eedb4af02c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.514175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9cd02-93c5-43e0-bd79-a7eedb4af02c None admin] PATH_INFO: `/v3/users/f55f145dc4c84159a1030b877574062a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.527265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2cf61cd6-4fbf-41eb-9cd2-8cea49690a17 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:08.528283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2cf61cd6-4fbf-41eb-9cd2-8cea49690a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:08.529427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9cd02-93c5-43e0-bd79-a7eedb4af02c None admin] RBAC: Authorizing `identity:get_user(user_id=f55f145dc4c84159a1030b877574062a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:08.530953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9cd02-93c5-43e0-bd79-a7eedb4af02c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:08.534721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 133/281] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:08 2022] GET /identity/v3/users/f55f145dc4c84159a1030b877574062a => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:08.535366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9cd02-93c5-43e0-bd79-a7eedb4af02c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:08.569377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:08.618071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 149/282] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:08.619269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf61cd6-4fbf-41eb-9cd2-8cea49690a17 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:08.660752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9cd02-93c5-43e0-bd79-a7eedb4af02c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:08.698132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:08.709714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8c9c-d936-4e4d-8adf-3b7e010011bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:08.711048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8c9c-d936-4e4d-8adf-3b7e010011bd None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.711777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8c9c-d936-4e4d-8adf-3b7e010011bd None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.712244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b8c9c-d936-4e4d-8adf-3b7e010011bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.726883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b8c9c-d936-4e4d-8adf-3b7e010011bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-7d6b8c9c-d936-4e4d-8adf-3b7e010011bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:08.735180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:08.736304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:08.737292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:08.737948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 134/283] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:08.738708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8c9c-d936-4e4d-8adf-3b7e010011bd None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:08.754390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf61cd6-4fbf-41eb-9cd2-8cea49690a17 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:08.793932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4953f30-378c-4b8b-92d8-76da9304bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:08.794869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4953f30-378c-4b8b-92d8-76da9304bfdd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.795441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4953f30-378c-4b8b-92d8-76da9304bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.795866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4953f30-378c-4b8b-92d8-76da9304bfdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.796848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4953f30-378c-4b8b-92d8-76da9304bfdd None admin] RBAC: Adding query filter params (role.id=a284a48d48b2440997815469786a10ec, user.id=f55f145dc4c84159a1030b877574062a, scope.system=all) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:08.797357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4953f30-378c-4b8b-92d8-76da9304bfdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:08.799233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4953f30-378c-4b8b-92d8-76da9304bfdd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:08.805932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 150/284] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Jun 7 14:08:08 2022] GET /identity/v3/role_assignments?user.id=f55f145dc4c84159a1030b877574062a&scope.system=all&role.id=a284a48d48b2440997815469786a10ec => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:08.807018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4953f30-378c-4b8b-92d8-76da9304bfdd None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:08.836558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:08.848099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b8c9c-d936-4e4d-8adf-3b7e010011bd None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:08.894056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9d779-4320-4ce1-b6b9-341edd08a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:08.894887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9d779-4320-4ce1-b6b9-341edd08a935 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:08.895220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9d779-4320-4ce1-b6b9-341edd08a935 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:08.895655 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9d779-4320-4ce1-b6b9-341edd08a935 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:08.914706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9d779-4320-4ce1-b6b9-341edd08a935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-8bb9d779-4320-4ce1-b6b9-341edd08a935 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:08.924747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:08.926020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:08.927584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 135/285] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:08.932593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9d779-4320-4ce1-b6b9-341edd08a935 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:09.001634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4953f30-378c-4b8b-92d8-76da9304bfdd None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:09.055796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:09.106262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25366eda-5d5d-485b-aba3-099c20c820d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:09.106945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25366eda-5d5d-485b-aba3-099c20c820d9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:09.107228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25366eda-5d5d-485b-aba3-099c20c820d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:09.107716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25366eda-5d5d-485b-aba3-099c20c820d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:09.108484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25366eda-5d5d-485b-aba3-099c20c820d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:09.108792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25366eda-5d5d-485b-aba3-099c20c820d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:09.110166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25366eda-5d5d-485b-aba3-099c20c820d9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:09.113544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9d779-4320-4ce1-b6b9-341edd08a935 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:09.129777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 151/286] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:09.135565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25366eda-5d5d-485b-aba3-099c20c820d9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:09.182244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cddd1-dded-499b-ad4a-4a848e33d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:09.182851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cddd1-dded-499b-ad4a-4a848e33d913 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:09.183138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cddd1-dded-499b-ad4a-4a848e33d913 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:09.183469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cddd1-dded-499b-ad4a-4a848e33d913 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:09.184388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cddd1-dded-499b-ad4a-4a848e33d913 None admin] RBAC: Adding query filter params (name=member) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:09.184703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cddd1-dded-499b-ad4a-4a848e33d913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:09.186101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cddd1-dded-499b-ad4a-4a848e33d913 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:09.195925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 136/287] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:09.202183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cddd1-dded-499b-ad4a-4a848e33d913 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:09.220944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:09.362414 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25366eda-5d5d-485b-aba3-099c20c820d9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:09.392004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cddd1-dded-499b-ad4a-4a848e33d913 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:09.435004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e449be2-d785-443d-9110-6d45249be668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:09.435829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e449be2-d785-443d-9110-6d45249be668 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:09.436115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e449be2-d785-443d-9110-6d45249be668 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:09.436396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e449be2-d785-443d-9110-6d45249be668 None admin] PATH_INFO: `/v3/users/7e5d64bc3fd64cf48231c550e6c7c734` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:09.437773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e449be2-d785-443d-9110-6d45249be668 None admin] RBAC: Authorizing `identity:get_user(user_id=7e5d64bc3fd64cf48231c550e6c7c734)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:09.439211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e449be2-d785-443d-9110-6d45249be668 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:09.441179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 152/288] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:09 2022] GET /identity/v3/users/7e5d64bc3fd64cf48231c550e6c7c734 => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:09.447357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e449be2-d785-443d-9110-6d45249be668 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:09.459975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1039629-68d2-4401-ace3-7ccfe1ff3993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:09.460866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1039629-68d2-4401-ace3-7ccfe1ff3993 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:09.461380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1039629-68d2-4401-ace3-7ccfe1ff3993 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:09.461452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1039629-68d2-4401-ace3-7ccfe1ff3993 None admin] PATH_INFO: `/v3/users/348faa0673704e08a5d4b297e2027fea` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:09.462640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1039629-68d2-4401-ace3-7ccfe1ff3993 None admin] RBAC: Authorizing `identity:get_user(user_id=348faa0673704e08a5d4b297e2027fea)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:09.464147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1039629-68d2-4401-ace3-7ccfe1ff3993 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:09.465783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 137/289] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:09 2022] GET /identity/v3/users/348faa0673704e08a5d4b297e2027fea => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:09.483473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1039629-68d2-4401-ace3-7ccfe1ff3993 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:09.555152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:09.619454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e449be2-d785-443d-9110-6d45249be668 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:09.634777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:09.659235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156aef3-ed88-4bc1-af46-2ef0520d3275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:09.660849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156aef3-ed88-4bc1-af46-2ef0520d3275 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:09.661351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156aef3-ed88-4bc1-af46-2ef0520d3275 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:09.661854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156aef3-ed88-4bc1-af46-2ef0520d3275 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:09.670268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156aef3-ed88-4bc1-af46-2ef0520d3275 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:09.670268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156aef3-ed88-4bc1-af46-2ef0520d3275 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:09.670268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 153/290] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:09 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:09.680348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156aef3-ed88-4bc1-af46-2ef0520d3275 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:09.682643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1039629-68d2-4401-ace3-7ccfe1ff3993 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:09.765392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b1e69-ab4a-495a-8640-de137c09ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:09.766332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b1e69-ab4a-495a-8640-de137c09ef03 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:09.766760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b1e69-ab4a-495a-8640-de137c09ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:09.767179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b1e69-ab4a-495a-8640-de137c09ef03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:09.800570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156aef3-ed88-4bc1-af46-2ef0520d3275 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:09.823748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:09.855900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf07a5a-8ee2-4a63-b59a-aad5d21ded20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:09.857077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf07a5a-8ee2-4a63-b59a-aad5d21ded20 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:09.857361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf07a5a-8ee2-4a63-b59a-aad5d21ded20 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:09.857637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf07a5a-8ee2-4a63-b59a-aad5d21ded20 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590/users/7e5d64bc3fd64cf48231c550e6c7c734/roles/aa51c41209054701acd2b9e3bbe58114` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:09.861341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf07a5a-8ee2-4a63-b59a-aad5d21ded20 None admin] RBAC: Authorizing `identity:create_grant(project_id=309bfab87fbe44008938ccbd283fd590, user_id=7e5d64bc3fd64cf48231c550e6c7c734, role_id=aa51c41209054701acd2b9e3bbe58114)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:09.862796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf07a5a-8ee2-4a63-b59a-aad5d21ded20 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:09.891521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 154/291] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:08:09 2022] PUT /identity/v3/projects/309bfab87fbe44008938ccbd283fd590/users/7e5d64bc3fd64cf48231c550e6c7c734/roles/aa51c41209054701acd2b9e3bbe58114 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:09.906997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b1e69-ab4a-495a-8640-de137c09ef03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:09.908586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b1e69-ab4a-495a-8640-de137c09ef03 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:10.017819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:10.050347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 138/292] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:10.056644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf07a5a-8ee2-4a63-b59a-aad5d21ded20 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:10.170174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf07a5a-8ee2-4a63-b59a-aad5d21ded20 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:10.208007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6607f5a-efcb-4595-aaaa-e9576f4cf132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:10.208910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6607f5a-efcb-4595-aaaa-e9576f4cf132 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:10.209211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6607f5a-efcb-4595-aaaa-e9576f4cf132 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:10.209493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6607f5a-efcb-4595-aaaa-e9576f4cf132 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:10.211076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6607f5a-efcb-4595-aaaa-e9576f4cf132 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:10.212553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6607f5a-efcb-4595-aaaa-e9576f4cf132 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:10.214629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 155/293] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:10 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:10.220850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b1e69-ab4a-495a-8640-de137c09ef03 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:10.358571 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b1e69-ab4a-495a-8640-de137c09ef03 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:10.408190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d5993-564e-494b-8550-2a3e88ca3608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:10.408862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d5993-564e-494b-8550-2a3e88ca3608 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:10.409149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d5993-564e-494b-8550-2a3e88ca3608 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:10.409427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d5993-564e-494b-8550-2a3e88ca3608 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:10.410276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d5993-564e-494b-8550-2a3e88ca3608 None admin] RBAC: Adding query filter params (role.id=a284a48d48b2440997815469786a10ec, scope.project.id=309bfab87fbe44008938ccbd283fd590, user.id=348faa0673704e08a5d4b297e2027fea) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:10.411121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d5993-564e-494b-8550-2a3e88ca3608 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:10.412610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d5993-564e-494b-8550-2a3e88ca3608 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:10.422872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 139/294] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:10 2022] GET /identity/v3/role_assignments?user.id=348faa0673704e08a5d4b297e2027fea&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=a284a48d48b2440997815469786a10ec => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:10.797982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb7323-10e3-4759-9a22-d7dce0ac1054 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:10.798484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb7323-10e3-4759-9a22-d7dce0ac1054 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:10.798560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb7323-10e3-4759-9a22-d7dce0ac1054 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:10.800195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 156/295] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:10.805419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767a2fd-75d0-4b88-aa64-13062ad55751 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:10.805817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767a2fd-75d0-4b88-aa64-13062ad55751 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:10.805999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767a2fd-75d0-4b88-aa64-13062ad55751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:10.823164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a767a2fd-75d0-4b88-aa64-13062ad55751 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:10.824418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a767a2fd-75d0-4b88-aa64-13062ad55751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:10.870715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:10.896885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf99d-7221-4854-91b6-87f57caaf2bd None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:10.897191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf99d-7221-4854-91b6-87f57caaf2bd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:10.897452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf99d-7221-4854-91b6-87f57caaf2bd None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:10.899096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 157/296] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:10.904927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fdf8-2e78-4a60-955f-3ccf9f462cdf None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:10.905223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fdf8-2e78-4a60-955f-3ccf9f462cdf None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:10.905507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316fdf8-2e78-4a60-955f-3ccf9f462cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:10.908604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 140/297] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:10.923853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b316fdf8-2e78-4a60-955f-3ccf9f462cdf None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:10.925069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b316fdf8-2e78-4a60-955f-3ccf9f462cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:10.935376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767a2fd-75d0-4b88-aa64-13062ad55751 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:10.979741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:11.002221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 158/298] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:11.026047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316fdf8-2e78-4a60-955f-3ccf9f462cdf None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:11.050671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767a2fd-75d0-4b88-aa64-13062ad55751 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:11.085835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57aa8a-aa0b-4e8a-800e-9c208a7b5a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:11.086632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57aa8a-aa0b-4e8a-800e-9c208a7b5a5a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:11.086916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57aa8a-aa0b-4e8a-800e-9c208a7b5a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:11.087190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57aa8a-aa0b-4e8a-800e-9c208a7b5a5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:11.097537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57aa8a-aa0b-4e8a-800e-9c208a7b5a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-ef57aa8a-aa0b-4e8a-800e-9c208a7b5a5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:11.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:11.106081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:11.107314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 141/299] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:11.112177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57aa8a-aa0b-4e8a-800e-9c208a7b5a5a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:11.140385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316fdf8-2e78-4a60-955f-3ccf9f462cdf None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:11.147144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:11.175003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c7056-03cc-4803-ac22-9c7493c5a80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:11.175843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c7056-03cc-4803-ac22-9c7493c5a80d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:11.176150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c7056-03cc-4803-ac22-9c7493c5a80d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:11.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c7056-03cc-4803-ac22-9c7493c5a80d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:11.177620 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c7056-03cc-4803-ac22-9c7493c5a80d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:11.179069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c7056-03cc-4803-ac22-9c7493c5a80d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:11.181051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 159/300] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:11.186864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c7056-03cc-4803-ac22-9c7493c5a80d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:11.226680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57aa8a-aa0b-4e8a-800e-9c208a7b5a5a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:11.269763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4ba6-eee8-4267-97d5-268a61c765ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:11.271015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4ba6-eee8-4267-97d5-268a61c765ad None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:11.271304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4ba6-eee8-4267-97d5-268a61c765ad None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:11.271632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4ba6-eee8-4267-97d5-268a61c765ad None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:11.272669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca4ba6-eee8-4267-97d5-268a61c765ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:11.272978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca4ba6-eee8-4267-97d5-268a61c765ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:11.275307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca4ba6-eee8-4267-97d5-268a61c765ad None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:11.289858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 142/301] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:11.290893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4ba6-eee8-4267-97d5-268a61c765ad None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:11.300217 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:11.312337 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c7056-03cc-4803-ac22-9c7493c5a80d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:11.363057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8141fb-c508-4f9e-af8e-f12c576d7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:11.363993 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8141fb-c508-4f9e-af8e-f12c576d7bec None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:11.364189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8141fb-c508-4f9e-af8e-f12c576d7bec None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:11.364472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8141fb-c508-4f9e-af8e-f12c576d7bec None admin] PATH_INFO: `/v3/groups` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:11.365245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8141fb-c508-4f9e-af8e-f12c576d7bec None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:11.366864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8141fb-c508-4f9e-af8e-f12c576d7bec None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:11.393461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 160/302] 10.222.0.77 () {60 vars in 1134 bytes} [Tue Jun 7 14:08:11 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:08:11.419799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:11.428785 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4ba6-eee8-4267-97d5-268a61c765ad None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:11.467669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5eecb-55b0-4a1e-a82a-7db573de0e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:11.468580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5eecb-55b0-4a1e-a82a-7db573de0e75 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:11.468864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5eecb-55b0-4a1e-a82a-7db573de0e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:11.469141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5eecb-55b0-4a1e-a82a-7db573de0e75 None admin] PATH_INFO: `/v3/users/d831303efd364cfcb6a31335eaa047b1` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:11.485101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5eecb-55b0-4a1e-a82a-7db573de0e75 None admin] RBAC: Authorizing `identity:get_user(user_id=d831303efd364cfcb6a31335eaa047b1)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:11.486730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5eecb-55b0-4a1e-a82a-7db573de0e75 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:11.494038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 143/303] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:11 2022] GET /identity/v3/users/d831303efd364cfcb6a31335eaa047b1 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:11.496238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8141fb-c508-4f9e-af8e-f12c576d7bec None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:11.611980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8141fb-c508-4f9e-af8e-f12c576d7bec None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:11.621009 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:11.658517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6e0ad-f11d-4385-a675-7283ae82e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:11.659188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e0ad-f11d-4385-a675-7283ae82e4aa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:11.659504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e0ad-f11d-4385-a675-7283ae82e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:11.659785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e0ad-f11d-4385-a675-7283ae82e4aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:11.660668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6e0ad-f11d-4385-a675-7283ae82e4aa None admin] RBAC: Adding query filter params (role.id=aa51c41209054701acd2b9e3bbe58114, user.id=d831303efd364cfcb6a31335eaa047b1, scope.system=all) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:11.660983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6e0ad-f11d-4385-a675-7283ae82e4aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:11.662419 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6e0ad-f11d-4385-a675-7283ae82e4aa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:11.670122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 161/304] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Jun 7 14:08:11 2022] GET /identity/v3/role_assignments?user.id=d831303efd364cfcb6a31335eaa047b1&scope.system=all&role.id=aa51c41209054701acd2b9e3bbe58114 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:11.692444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031db0a-f6b9-4dd1-88f2-48a62766275f None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:11.692737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031db0a-f6b9-4dd1-88f2-48a62766275f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:11.693005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031db0a-f6b9-4dd1-88f2-48a62766275f None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:11.694605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 144/305] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:11.700758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53203af2-6583-471d-af85-ca259c726009 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:11.701113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53203af2-6583-471d-af85-ca259c726009 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:11.701314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53203af2-6583-471d-af85-ca259c726009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:11.723688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-53203af2-6583-471d-af85-ca259c726009 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:11.724902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-53203af2-6583-471d-af85-ca259c726009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:11.803908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 162/306] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:11.826596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031db0a-f6b9-4dd1-88f2-48a62766275f None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:11.936384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031db0a-f6b9-4dd1-88f2-48a62766275f None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:11.972223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa59b4-3f54-4f23-8592-62c3338d8d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:11.973570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa59b4-3f54-4f23-8592-62c3338d8d9e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:11.973856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa59b4-3f54-4f23-8592-62c3338d8d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:11.974130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa59b4-3f54-4f23-8592-62c3338d8d9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:11.984776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa59b4-3f54-4f23-8592-62c3338d8d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-7baa59b4-3f54-4f23-8592-62c3338d8d9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:11.993247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:11.994285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:11.995254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 145/307] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:12.000925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53203af2-6583-471d-af85-ca259c726009 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:12.101445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:12.104765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53203af2-6583-471d-af85-ca259c726009 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:12.140642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2511aa-05c1-4dc2-8fbf-a89b19b2c31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:12.141320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2511aa-05c1-4dc2-8fbf-a89b19b2c31e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:12.141604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2511aa-05c1-4dc2-8fbf-a89b19b2c31e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:12.141882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2511aa-05c1-4dc2-8fbf-a89b19b2c31e None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:12.142639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2511aa-05c1-4dc2-8fbf-a89b19b2c31e None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:12.142944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2511aa-05c1-4dc2-8fbf-a89b19b2c31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:12.144360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2511aa-05c1-4dc2-8fbf-a89b19b2c31e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:12.153730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 163/308] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:12.160517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa59b4-3f54-4f23-8592-62c3338d8d9e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:12.187846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:12.273437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa59b4-3f54-4f23-8592-62c3338d8d9e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:12.308617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f4414-b1a8-4257-8000-60e8a039bfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:12.309502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4414-b1a8-4257-8000-60e8a039bfff None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:12.309795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4414-b1a8-4257-8000-60e8a039bfff None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:12.310075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f4414-b1a8-4257-8000-60e8a039bfff None admin] PATH_INFO: `/v3/users/f55f145dc4c84159a1030b877574062a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:12.311285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f4414-b1a8-4257-8000-60e8a039bfff None admin] RBAC: Authorizing `identity:get_user(user_id=f55f145dc4c84159a1030b877574062a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:12.312824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f4414-b1a8-4257-8000-60e8a039bfff None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:12.314822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 146/309] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:12 2022] GET /identity/v3/users/f55f145dc4c84159a1030b877574062a => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:12.320688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2511aa-05c1-4dc2-8fbf-a89b19b2c31e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:12.434799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2511aa-05c1-4dc2-8fbf-a89b19b2c31e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:12.470114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8a8a8-7bfe-49c3-892d-721efeb37d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:12.470896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8a8a8-7bfe-49c3-892d-721efeb37d56 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:12.471180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8a8a8-7bfe-49c3-892d-721efeb37d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:12.471492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8a8a8-7bfe-49c3-892d-721efeb37d56 None admin] PATH_INFO: `/v3/system/users/f55f145dc4c84159a1030b877574062a/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:12.473046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8a8a8-7bfe-49c3-892d-721efeb37d56 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f55f145dc4c84159a1030b877574062a, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:12.474488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8a8a8-7bfe-49c3-892d-721efeb37d56 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:12.484208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 164/310] 10.222.0.77 () {58 vars in 1334 bytes} [Tue Jun 7 14:08:12 2022] PUT /identity/v3/system/users/f55f145dc4c84159a1030b877574062a/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:12.529126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30819470-dffa-4eb1-90df-522838910212 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:12.529780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30819470-dffa-4eb1-90df-522838910212 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:12.530292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30819470-dffa-4eb1-90df-522838910212 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:12.531986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 147/311] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:12.539621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3dd41-b75e-40fe-98a1-d56c40cfae31 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:12.540242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3dd41-b75e-40fe-98a1-d56c40cfae31 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:12.540717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3dd41-b75e-40fe-98a1-d56c40cfae31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:12.560016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-65a3dd41-b75e-40fe-98a1-d56c40cfae31 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:12.561584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-65a3dd41-b75e-40fe-98a1-d56c40cfae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:12.586693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:12.648661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 165/312] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:12.672347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30819470-dffa-4eb1-90df-522838910212 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:12.762246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:12.782409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30819470-dffa-4eb1-90df-522838910212 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:12.817587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3847a41-ac3d-4053-9989-a117b6e0f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:12.818391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3847a41-ac3d-4053-9989-a117b6e0f5ae None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:12.818673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3847a41-ac3d-4053-9989-a117b6e0f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:12.818948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3847a41-ac3d-4053-9989-a117b6e0f5ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:12.829492 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3847a41-ac3d-4053-9989-a117b6e0f5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e3847a41-ac3d-4053-9989-a117b6e0f5ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:12.837464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:12.838319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:12.839117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 148/313] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:12.844938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3dd41-b75e-40fe-98a1-d56c40cfae31 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:12.954859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3dd41-b75e-40fe-98a1-d56c40cfae31 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:12.991259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc0eb-36f3-44a3-98c4-fdeb0c8ba841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:12.991964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc0eb-36f3-44a3-98c4-fdeb0c8ba841 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:12.992248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc0eb-36f3-44a3-98c4-fdeb0c8ba841 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:12.992524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc0eb-36f3-44a3-98c4-fdeb0c8ba841 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:12.993280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc0eb-36f3-44a3-98c4-fdeb0c8ba841 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:12.993585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc0eb-36f3-44a3-98c4-fdeb0c8ba841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:12.994945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc0eb-36f3-44a3-98c4-fdeb0c8ba841 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:13.004051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 166/314] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:13.009319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3847a41-ac3d-4053-9989-a117b6e0f5ae None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:13.124325 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3847a41-ac3d-4053-9989-a117b6e0f5ae None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:13.162929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48dfd6-4737-4674-8080-14dc91c699cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:13.163833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48dfd6-4737-4674-8080-14dc91c699cb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:13.164132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48dfd6-4737-4674-8080-14dc91c699cb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:13.164446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48dfd6-4737-4674-8080-14dc91c699cb None admin] PATH_INFO: `/v3/users/7e5d64bc3fd64cf48231c550e6c7c734` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:13.165711 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48dfd6-4737-4674-8080-14dc91c699cb None admin] RBAC: Authorizing `identity:get_user(user_id=7e5d64bc3fd64cf48231c550e6c7c734)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:13.167148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48dfd6-4737-4674-8080-14dc91c699cb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:13.169174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 149/315] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:13 2022] GET /identity/v3/users/7e5d64bc3fd64cf48231c550e6c7c734 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:13.174603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc0eb-36f3-44a3-98c4-fdeb0c8ba841 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:13.194943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:13.282918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc0eb-36f3-44a3-98c4-fdeb0c8ba841 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:13.321369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7b3d3-bbad-4c25-a017-598f5d7a488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:13.322030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7b3d3-bbad-4c25-a017-598f5d7a488d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:13.322314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7b3d3-bbad-4c25-a017-598f5d7a488d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:13.322592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7b3d3-bbad-4c25-a017-598f5d7a488d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:13.397153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7b3d3-bbad-4c25-a017-598f5d7a488d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:13.398532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7b3d3-bbad-4c25-a017-598f5d7a488d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:13.417207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:13.508386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 167/316] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:13.513903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48dfd6-4737-4674-8080-14dc91c699cb None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:13.527731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:13.630194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48dfd6-4737-4674-8080-14dc91c699cb None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:13.667215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf48cd-0607-4382-8749-40665bce878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:13.668030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf48cd-0607-4382-8749-40665bce878f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:13.668317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf48cd-0607-4382-8749-40665bce878f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:13.668598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf48cd-0607-4382-8749-40665bce878f None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:13.669808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf48cd-0607-4382-8749-40665bce878f None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:13.671229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf48cd-0607-4382-8749-40665bce878f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:13.673272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 150/317] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:13 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:13.680437 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7b3d3-bbad-4c25-a017-598f5d7a488d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:13.789123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7b3d3-bbad-4c25-a017-598f5d7a488d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:13.792618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4df2c-ca30-46f5-a8ad-72fb74aaaca7 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:13.793123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4df2c-ca30-46f5-a8ad-72fb74aaaca7 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:13.793623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4df2c-ca30-46f5-a8ad-72fb74aaaca7 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:13.795191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 151/318] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:13.800103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25190034-751b-4138-8aad-b21dbb7b8556 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:13.800640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25190034-751b-4138-8aad-b21dbb7b8556 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:13.801661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25190034-751b-4138-8aad-b21dbb7b8556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:13.819065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-25190034-751b-4138-8aad-b21dbb7b8556 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:13.820576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-25190034-751b-4138-8aad-b21dbb7b8556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:13.831882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:13.843764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ccd28-ddb8-4259-acf2-512c165cc22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:13.844546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ccd28-ddb8-4259-acf2-512c165cc22d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:13.844909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ccd28-ddb8-4259-acf2-512c165cc22d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:13.845194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ccd28-ddb8-4259-acf2-512c165cc22d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:13.846036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ccd28-ddb8-4259-acf2-512c165cc22d None admin] RBAC: Adding query filter params (role.id=aa51c41209054701acd2b9e3bbe58114, scope.project.id=309bfab87fbe44008938ccbd283fd590, user.id=7e5d64bc3fd64cf48231c550e6c7c734) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:13.846346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ccd28-ddb8-4259-acf2-512c165cc22d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:13.848357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143ccd28-ddb8-4259-acf2-512c165cc22d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:13.856838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 168/319] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:13 2022] GET /identity/v3/role_assignments?user.id=7e5d64bc3fd64cf48231c550e6c7c734&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=aa51c41209054701acd2b9e3bbe58114 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:13.916215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 152/320] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:13.939986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ccd28-ddb8-4259-acf2-512c165cc22d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:14.050856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ccd28-ddb8-4259-acf2-512c165cc22d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:14.088771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24960e2-8650-449d-be92-19c51e06ce9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:14.089813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24960e2-8650-449d-be92-19c51e06ce9c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.090250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24960e2-8650-449d-be92-19c51e06ce9c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.090669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24960e2-8650-449d-be92-19c51e06ce9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.092043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24960e2-8650-449d-be92-19c51e06ce9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:14.093618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24960e2-8650-449d-be92-19c51e06ce9c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:14.095786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 169/321] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:14.101606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25190034-751b-4138-8aad-b21dbb7b8556 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:14.112977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:14.123040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce49921-fd9a-4550-b9f0-eab0a536cd82 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.123394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce49921-fd9a-4550-b9f0-eab0a536cd82 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.123819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce49921-fd9a-4550-b9f0-eab0a536cd82 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.125639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 170/322] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:14.130674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6351f-74eb-4dcb-bbdc-b010669ef129 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.131048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6351f-74eb-4dcb-bbdc-b010669ef129 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.131321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d6351f-74eb-4dcb-bbdc-b010669ef129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.149170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-24d6351f-74eb-4dcb-bbdc-b010669ef129 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:14.150365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-24d6351f-74eb-4dcb-bbdc-b010669ef129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:14.203705 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:14.224920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25190034-751b-4138-8aad-b21dbb7b8556 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:14.227370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 171/323] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:14.249946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6351f-74eb-4dcb-bbdc-b010669ef129 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:14.261258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c276ce-2947-4810-bbf4-c7da7d18d3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:14.262002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c276ce-2947-4810-bbf4-c7da7d18d3b9 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.262292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c276ce-2947-4810-bbf4-c7da7d18d3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.262572 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c276ce-2947-4810-bbf4-c7da7d18d3b9 None admin] PATH_INFO: `/v3/groups` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.263283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c276ce-2947-4810-bbf4-c7da7d18d3b9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:14.264749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c276ce-2947-4810-bbf4-c7da7d18d3b9 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:14.280135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 153/324] 10.222.0.77 () {60 vars in 1134 bytes} [Tue Jun 7 14:08:14 2022] POST /identity/v3/groups => generated 226 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:08:14.368803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d6351f-74eb-4dcb-bbdc-b010669ef129 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:14.405362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d997d5e-99e8-4cd6-ab05-219a57951d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:14.406177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d997d5e-99e8-4cd6-ab05-219a57951d9f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.406459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d997d5e-99e8-4cd6-ab05-219a57951d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.406733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d997d5e-99e8-4cd6-ab05-219a57951d9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.418851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d997d5e-99e8-4cd6-ab05-219a57951d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2d997d5e-99e8-4cd6-ab05-219a57951d9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:14.426871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:14.428111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:14.433777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 172/325] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:14.434465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c276ce-2947-4810-bbf4-c7da7d18d3b9 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:14.515193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:14.555865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c276ce-2947-4810-bbf4-c7da7d18d3b9 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:14.595238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804e78-6cf2-4aa1-9acc-742b747182b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:14.596194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804e78-6cf2-4aa1-9acc-742b747182b5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.596631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804e78-6cf2-4aa1-9acc-742b747182b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.597058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb804e78-6cf2-4aa1-9acc-742b747182b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.598536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb804e78-6cf2-4aa1-9acc-742b747182b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:14.598997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb804e78-6cf2-4aa1-9acc-742b747182b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:14.600582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb804e78-6cf2-4aa1-9acc-742b747182b5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:14.610763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 154/326] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:14.615810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d997d5e-99e8-4cd6-ab05-219a57951d9f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:14.663809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:14.731318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d997d5e-99e8-4cd6-ab05-219a57951d9f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:14.769376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b60b12-e224-4135-94fa-196ca354d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:14.770725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b60b12-e224-4135-94fa-196ca354d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.771006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b60b12-e224-4135-94fa-196ca354d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.771283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b60b12-e224-4135-94fa-196ca354d0f1 None admin] PATH_INFO: `/v3/users/d831303efd364cfcb6a31335eaa047b1` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.772539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b60b12-e224-4135-94fa-196ca354d0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d831303efd364cfcb6a31335eaa047b1)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:14.773976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b60b12-e224-4135-94fa-196ca354d0f1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:14.776022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 173/327] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:14 2022] GET /identity/v3/users/d831303efd364cfcb6a31335eaa047b1 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:14.781140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804e78-6cf2-4aa1-9acc-742b747182b5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:14.891192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f5155-0359-4b03-918e-2b6f86cf074d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.891720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f5155-0359-4b03-918e-2b6f86cf074d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.891720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f5155-0359-4b03-918e-2b6f86cf074d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.893262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 174/328] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:14.898587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c5ade-cb04-42cf-89be-483131a4d26f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.898884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c5ade-cb04-42cf-89be-483131a4d26f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.899170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c5ade-cb04-42cf-89be-483131a4d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.908795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb804e78-6cf2-4aa1-9acc-742b747182b5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:14.918617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c29c5ade-cb04-42cf-89be-483131a4d26f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:14.919874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c29c5ade-cb04-42cf-89be-483131a4d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:14.945205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:14.953772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2af92-e695-4133-a2e0-95c13ab4b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:14.954791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2af92-e695-4133-a2e0-95c13ab4b396 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:14.955407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2af92-e695-4133-a2e0-95c13ab4b396 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:14.955757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2af92-e695-4133-a2e0-95c13ab4b396 None admin] PATH_INFO: `/v3/system/users/d831303efd364cfcb6a31335eaa047b1/roles/aa51c41209054701acd2b9e3bbe58114` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:14.958354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2af92-e695-4133-a2e0-95c13ab4b396 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d831303efd364cfcb6a31335eaa047b1, role_id=aa51c41209054701acd2b9e3bbe58114)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:14.960374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2af92-e695-4133-a2e0-95c13ab4b396 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:14.971288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 155/329] 10.222.0.77 () {58 vars in 1334 bytes} [Tue Jun 7 14:08:14 2022] PUT /identity/v3/system/users/d831303efd364cfcb6a31335eaa047b1/roles/aa51c41209054701acd2b9e3bbe58114 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:15.011366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 175/330] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:15.036915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2af92-e695-4133-a2e0-95c13ab4b396 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:15.151716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2af92-e695-4133-a2e0-95c13ab4b396 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:15.195531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678d384-914f-46ca-888c-95f5d5ff50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:15.196341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678d384-914f-46ca-888c-95f5d5ff50c1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:15.196627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678d384-914f-46ca-888c-95f5d5ff50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:15.196903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678d384-914f-46ca-888c-95f5d5ff50c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:15.211488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678d384-914f-46ca-888c-95f5d5ff50c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e678d384-914f-46ca-888c-95f5d5ff50c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:15.220057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:15.221042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:15.221869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:15.224473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 156/331] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:15.232521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c5ade-cb04-42cf-89be-483131a4d26f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:15.289534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:15.356704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c5ade-cb04-42cf-89be-483131a4d26f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:15.393767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1b2c4-611d-4767-9df8-492c88518654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:15.394442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b2c4-611d-4767-9df8-492c88518654 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:15.394756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b2c4-611d-4767-9df8-492c88518654 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:15.395034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1b2c4-611d-4767-9df8-492c88518654 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:15.395823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1b2c4-611d-4767-9df8-492c88518654 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:15.396131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1b2c4-611d-4767-9df8-492c88518654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:15.397500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1b2c4-611d-4767-9df8-492c88518654 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:15.406328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 176/332] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:15.412128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678d384-914f-46ca-888c-95f5d5ff50c1 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:15.480372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:15.545752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678d384-914f-46ca-888c-95f5d5ff50c1 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:15.598243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f27a4-1656-4bd0-a0b6-2b74ad00a220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:15.599145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f27a4-1656-4bd0-a0b6-2b74ad00a220 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:15.599458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f27a4-1656-4bd0-a0b6-2b74ad00a220 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:15.599738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f27a4-1656-4bd0-a0b6-2b74ad00a220 None admin] PATH_INFO: `/v3/users/f55f145dc4c84159a1030b877574062a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:15.604086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f27a4-1656-4bd0-a0b6-2b74ad00a220 None admin] RBAC: Authorizing `identity:get_user(user_id=f55f145dc4c84159a1030b877574062a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:15.605611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f27a4-1656-4bd0-a0b6-2b74ad00a220 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:15.607896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 157/333] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:15 2022] GET /identity/v3/users/f55f145dc4c84159a1030b877574062a => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:15.614314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1b2c4-611d-4767-9df8-492c88518654 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:15.726715 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1b2c4-611d-4767-9df8-492c88518654 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:15.734115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:15.762630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4938b43-1adc-48e7-91ce-3f9333ee527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:15.763296 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938b43-1adc-48e7-91ce-3f9333ee527d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:15.763612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938b43-1adc-48e7-91ce-3f9333ee527d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:15.763893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4938b43-1adc-48e7-91ce-3f9333ee527d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:15.764750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4938b43-1adc-48e7-91ce-3f9333ee527d None admin] RBAC: Adding query filter params (role.id=a284a48d48b2440997815469786a10ec, user.id=f55f145dc4c84159a1030b877574062a, scope.system=all) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:15.765064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4938b43-1adc-48e7-91ce-3f9333ee527d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:15.766501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4938b43-1adc-48e7-91ce-3f9333ee527d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:15.779852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 177/334] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Jun 7 14:08:15 2022] GET /identity/v3/role_assignments?user.id=f55f145dc4c84159a1030b877574062a&scope.system=all&role.id=a284a48d48b2440997815469786a10ec => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:17.186550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac3cee-f375-4623-886f-6bbd9abf418a None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:17.187503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac3cee-f375-4623-886f-6bbd9abf418a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:17.187934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac3cee-f375-4623-886f-6bbd9abf418a None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:17.189666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 158/335] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:17.205103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bef09-2a05-4970-998b-51a1be459726 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:17.205592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bef09-2a05-4970-998b-51a1be459726 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:17.205697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601bef09-2a05-4970-998b-51a1be459726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:17.226534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-601bef09-2a05-4970-998b-51a1be459726 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:17.227759 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-601bef09-2a05-4970-998b-51a1be459726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:17.316095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e342-ffdd-436a-b780-e1f5d3b19c0c None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:17.316471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e342-ffdd-436a-b780-e1f5d3b19c0c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:17.316695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e342-ffdd-436a-b780-e1f5d3b19c0c None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:17.318194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 159/336] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:17.320574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 178/337] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:17.323425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8f0b-a691-42f0-9a32-6a12c00b67d7 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:17.323715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8f0b-a691-42f0-9a32-6a12c00b67d7 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:17.323993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8f0b-a691-42f0-9a32-6a12c00b67d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:17.341849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-652f8f0b-a691-42f0-9a32-6a12c00b67d7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:17.343029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-652f8f0b-a691-42f0-9a32-6a12c00b67d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:17.389815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bef09-2a05-4970-998b-51a1be459726 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:17.466045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 160/338] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:17.512610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8f0b-a691-42f0-9a32-6a12c00b67d7 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:17.568876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:17.596953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601bef09-2a05-4970-998b-51a1be459726 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:17.611191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:17.680979 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862170-5278-47fe-8b98-17fa02e70365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:17.681811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862170-5278-47fe-8b98-17fa02e70365 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:17.682095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862170-5278-47fe-8b98-17fa02e70365 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:17.682370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862170-5278-47fe-8b98-17fa02e70365 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:17.708664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8862170-5278-47fe-8b98-17fa02e70365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:17.709742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8f0b-a691-42f0-9a32-6a12c00b67d7 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e8862170-5278-47fe-8b98-17fa02e70365 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:17.723429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:17.724328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:17.725118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:17.728417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 179/339] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:08:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:17.734551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862170-5278-47fe-8b98-17fa02e70365 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:17.783898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538f08-3ed5-4d21-807f-17c5d92d60fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:17.786404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538f08-3ed5-4d21-807f-17c5d92d60fa None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:17.786404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538f08-3ed5-4d21-807f-17c5d92d60fa None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:17.786404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538f08-3ed5-4d21-807f-17c5d92d60fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:17.808190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da538f08-3ed5-4d21-807f-17c5d92d60fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-da538f08-3ed5-4d21-807f-17c5d92d60fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:17.817308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:17.818221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:17.819015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:17.822423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 161/340] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:17.828485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538f08-3ed5-4d21-807f-17c5d92d60fa None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:17.918849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862170-5278-47fe-8b98-17fa02e70365 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:17.956986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25d28f-c3ab-4ff0-8cfb-29b2cbac4a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:17.958195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25d28f-c3ab-4ff0-8cfb-29b2cbac4a43 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:17.958479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25d28f-c3ab-4ff0-8cfb-29b2cbac4a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:17.958921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25d28f-c3ab-4ff0-8cfb-29b2cbac4a43 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:17.959714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25d28f-c3ab-4ff0-8cfb-29b2cbac4a43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:17.960022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25d28f-c3ab-4ff0-8cfb-29b2cbac4a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:17.962813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f25d28f-c3ab-4ff0-8cfb-29b2cbac4a43 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:17.970921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 180/341] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:17.977379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25d28f-c3ab-4ff0-8cfb-29b2cbac4a43 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:18.003731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:18.100217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538f08-3ed5-4d21-807f-17c5d92d60fa None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:18.110461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25d28f-c3ab-4ff0-8cfb-29b2cbac4a43 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:18.141831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:18.152160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72c35-12e4-426f-bb0d-a6df45ac62ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:18.153024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72c35-12e4-426f-bb0d-a6df45ac62ad None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.153314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72c35-12e4-426f-bb0d-a6df45ac62ad None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.153644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72c35-12e4-426f-bb0d-a6df45ac62ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.216217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bbe4e-f07d-4fec-8714-9d9e5078a1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:18.216908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbe4e-f07d-4fec-8714-9d9e5078a1bb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.217202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbe4e-f07d-4fec-8714-9d9e5078a1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.217487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbe4e-f07d-4fec-8714-9d9e5078a1bb None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.218256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bbe4e-f07d-4fec-8714-9d9e5078a1bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:18.218570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bbe4e-f07d-4fec-8714-9d9e5078a1bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:18.220012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bbe4e-f07d-4fec-8714-9d9e5078a1bb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:18.232032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed72c35-12e4-426f-bb0d-a6df45ac62ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:18.234314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed72c35-12e4-426f-bb0d-a6df45ac62ad None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:18.240437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 162/342] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:18.245500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bbe4e-f07d-4fec-8714-9d9e5078a1bb None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:18.255725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:18.349424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 181/343] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:08:18.353533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72c35-12e4-426f-bb0d-a6df45ac62ad None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:18.464130 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72c35-12e4-426f-bb0d-a6df45ac62ad None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:18.502166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01a07-6ec1-414b-874d-ca1598c45d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:18.503092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01a07-6ec1-414b-874d-ca1598c45d44 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.503908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:18.504970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01a07-6ec1-414b-874d-ca1598c45d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.505386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c01a07-6ec1-414b-874d-ca1598c45d44 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.507672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c01a07-6ec1-414b-874d-ca1598c45d44 None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:18.509508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c01a07-6ec1-414b-874d-ca1598c45d44 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:18.512024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 182/344] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:18 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:18.517583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01a07-6ec1-414b-874d-ca1598c45d44 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:18.579324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bbe4e-f07d-4fec-8714-9d9e5078a1bb None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:18.630538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c01a07-6ec1-414b-874d-ca1598c45d44 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:18.669080 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b5c01-f15a-4b2d-a314-8da45872721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:18.669949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5c01-f15a-4b2d-a314-8da45872721b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.670229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5c01-f15a-4b2d-a314-8da45872721b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.670504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5c01-f15a-4b2d-a314-8da45872721b None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.673358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c65fb-b54e-4457-9519-f94b31163a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:18.674230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c65fb-b54e-4457-9519-f94b31163a71 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.674712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c65fb-b54e-4457-9519-f94b31163a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.675209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c65fb-b54e-4457-9519-f94b31163a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.677526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b5c01-f15a-4b2d-a314-8da45872721b None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:18.679647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b5c01-f15a-4b2d-a314-8da45872721b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:18.681941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 183/345] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:18 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:18.683176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108b8a1-8e9b-4a75-a1fd-93638d9bf283 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.683494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108b8a1-8e9b-4a75-a1fd-93638d9bf283 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.683769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108b8a1-8e9b-4a75-a1fd-93638d9bf283 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.684984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 184/346] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:18.687192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da255e6b-4ce6-41b9-a16a-217785779f8e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.687486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da255e6b-4ce6-41b9-a16a-217785779f8e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.687812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da255e6b-4ce6-41b9-a16a-217785779f8e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.690542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 185/347] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:18.692443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da255e6b-4ce6-41b9-a16a-217785779f8e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:18.734076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:18.763439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:18.774266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c65fb-b54e-4457-9519-f94b31163a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:18.775871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c65fb-b54e-4457-9519-f94b31163a71 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:18.824911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da255e6b-4ce6-41b9-a16a-217785779f8e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:18.861632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73454d2a-7478-43ab-b629-75f1ec59c7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:18.862288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73454d2a-7478-43ab-b629-75f1ec59c7dc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.862572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73454d2a-7478-43ab-b629-75f1ec59c7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.862902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73454d2a-7478-43ab-b629-75f1ec59c7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.864540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73454d2a-7478-43ab-b629-75f1ec59c7dc None admin] RBAC: Adding query filter params (group.id=a7d4397ff5aa4d239492093495d99750, role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=a91db3386fe24593821f7424072923f8) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:18.864852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73454d2a-7478-43ab-b629-75f1ec59c7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:18.866443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73454d2a-7478-43ab-b629-75f1ec59c7dc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:18.872858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 186/348] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:18 2022] GET /identity/v3/role_assignments?group.id=a7d4397ff5aa4d239492093495d99750&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:18.874251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf15bf-47d3-42c2-8abc-100d3e1df610 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.874676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf15bf-47d3-42c2-8abc-100d3e1df610 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.874957 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf15bf-47d3-42c2-8abc-100d3e1df610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.891258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 163/349] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:18.892788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b5c5-203a-4d9a-a81f-0ca71f2289ef None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:18.893088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b5c5-203a-4d9a-a81f-0ca71f2289ef None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:18.893369 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499b5c5-203a-4d9a-a81f-0ca71f2289ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:18.903361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dbcf15bf-47d3-42c2-8abc-100d3e1df610 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:18.904557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dbcf15bf-47d3-42c2-8abc-100d3e1df610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:18.912123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8499b5c5-203a-4d9a-a81f-0ca71f2289ef None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:18.913381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8499b5c5-203a-4d9a-a81f-0ca71f2289ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:18.996694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 164/350] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:18.997575 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499b5c5-203a-4d9a-a81f-0ca71f2289ef None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:19.010243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:19.045831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 187/351] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:19.046407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf15bf-47d3-42c2-8abc-100d3e1df610 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:19.085716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:19.117810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499b5c5-203a-4d9a-a81f-0ca71f2289ef None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:19.163798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e3a09-0786-4e93-8b2a-84ea300f7992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:19.164689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e3a09-0786-4e93-8b2a-84ea300f7992 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.164968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e3a09-0786-4e93-8b2a-84ea300f7992 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.165240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e3a09-0786-4e93-8b2a-84ea300f7992 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.166631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e3a09-0786-4e93-8b2a-84ea300f7992 None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:19.168112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e3a09-0786-4e93-8b2a-84ea300f7992 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:19.170144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 165/352] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:18 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:19.170714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e3a09-0786-4e93-8b2a-84ea300f7992 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:19.173065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf15bf-47d3-42c2-8abc-100d3e1df610 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:19.238931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bde27-ac8e-40b4-87d5-e5da6366f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:19.239791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bde27-ac8e-40b4-87d5-e5da6366f5ce None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.240045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bde27-ac8e-40b4-87d5-e5da6366f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.240316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bde27-ac8e-40b4-87d5-e5da6366f5ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.266968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bde27-ac8e-40b4-87d5-e5da6366f5ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-969bde27-ac8e-40b4-87d5-e5da6366f5ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:19.277236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:19.278233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 07 14:08:19.279057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:19.280931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 188/353] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:19.281871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bde27-ac8e-40b4-87d5-e5da6366f5ce None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:19.371727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:19.393977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e3a09-0786-4e93-8b2a-84ea300f7992 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:19.437564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe5682-587a-4b87-9338-99a4b75eff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:19.438378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe5682-587a-4b87-9338-99a4b75eff6e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.438663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe5682-587a-4b87-9338-99a4b75eff6e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.438941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe5682-587a-4b87-9338-99a4b75eff6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.443762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:19.451493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bde27-ac8e-40b4-87d5-e5da6366f5ce None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:19.453213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe5682-587a-4b87-9338-99a4b75eff6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-efbe5682-587a-4b87-9338-99a4b75eff6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:19.462624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:19.465038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 166/354] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:19.466991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe5682-587a-4b87-9338-99a4b75eff6e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:19.496080 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2193b93-5ebc-4772-b64c-066569809dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:19.497761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2193b93-5ebc-4772-b64c-066569809dcf None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2193b93-5ebc-4772-b64c-066569809dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.498724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2193b93-5ebc-4772-b64c-066569809dcf None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.500209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2193b93-5ebc-4772-b64c-066569809dcf None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:19.502186 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2193b93-5ebc-4772-b64c-066569809dcf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:19.505676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 189/355] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:19 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:19.507193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8ac2-df9c-4f9a-8f3c-5ae7add0a4e6 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.507722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8ac2-df9c-4f9a-8f3c-5ae7add0a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.508211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c8ac2-df9c-4f9a-8f3c-5ae7add0a4e6 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.509691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 190/356] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:19.510577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8ac2-df9c-4f9a-8f3c-5ae7add0a4e6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:19.616115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe5682-587a-4b87-9338-99a4b75eff6e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:19.650164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:19.657499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c8ac2-df9c-4f9a-8f3c-5ae7add0a4e6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:19.657824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca652f3-585a-4544-80ab-a2dea578de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:19.658544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca652f3-585a-4544-80ab-a2dea578de79 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.658828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca652f3-585a-4544-80ab-a2dea578de79 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.659103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca652f3-585a-4544-80ab-a2dea578de79 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.659920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca652f3-585a-4544-80ab-a2dea578de79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:19.660280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca652f3-585a-4544-80ab-a2dea578de79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:19.662205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca652f3-585a-4544-80ab-a2dea578de79 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:19.677585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 167/357] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:19.677585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca652f3-585a-4544-80ab-a2dea578de79 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:19.703718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c11a3-ff22-4755-a8f5-f22c37db4299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:19.704837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c11a3-ff22-4755-a8f5-f22c37db4299 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.705404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c11a3-ff22-4755-a8f5-f22c37db4299 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.705878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c11a3-ff22-4755-a8f5-f22c37db4299 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.707091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c11a3-ff22-4755-a8f5-f22c37db4299 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:19.707781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c11a3-ff22-4755-a8f5-f22c37db4299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:19.709418 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c11a3-ff22-4755-a8f5-f22c37db4299 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:19.720034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 191/358] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:19.721656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0fb5-ea6d-46f9-8cd0-1e0a7c7c884d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.722145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0fb5-ea6d-46f9-8cd0-1e0a7c7c884d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.722669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0fb5-ea6d-46f9-8cd0-1e0a7c7c884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.740434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e0bd0fb5-ea6d-46f9-8cd0-1e0a7c7c884d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:19.741967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e0bd0fb5-ea6d-46f9-8cd0-1e0a7c7c884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:19.765148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:19.798437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca652f3-585a-4544-80ab-a2dea578de79 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:19.827964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 192/359] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:19.829606 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef85e8-7c97-4ccc-b5ef-413ff2ee3bfc None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.830117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef85e8-7c97-4ccc-b5ef-413ff2ee3bfc None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.830592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef85e8-7c97-4ccc-b5ef-413ff2ee3bfc None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.832112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 193/360] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:19.833006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef85e8-7c97-4ccc-b5ef-413ff2ee3bfc None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:19.846284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42514fbe-406a-4a7f-a2ca-c8316342d4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:19.846969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42514fbe-406a-4a7f-a2ca-c8316342d4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.847257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42514fbe-406a-4a7f-a2ca-c8316342d4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.847614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42514fbe-406a-4a7f-a2ca-c8316342d4d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.848473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42514fbe-406a-4a7f-a2ca-c8316342d4d5 None admin] RBAC: Adding query filter params (group.id=a7d4397ff5aa4d239492093495d99750, role.id=a284a48d48b2440997815469786a10ec, scope.project.id=a91db3386fe24593821f7424072923f8) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:19.848793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42514fbe-406a-4a7f-a2ca-c8316342d4d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:19.850669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42514fbe-406a-4a7f-a2ca-c8316342d4d5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:19.857907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 168/361] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:19 2022] GET /identity/v3/role_assignments?group.id=a7d4397ff5aa4d239492093495d99750&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=a284a48d48b2440997815469786a10ec => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:19.858752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42514fbe-406a-4a7f-a2ca-c8316342d4d5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:19.933507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:19.952774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef85e8-7c97-4ccc-b5ef-413ff2ee3bfc None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:19.986098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42514fbe-406a-4a7f-a2ca-c8316342d4d5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:19.993314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa487d4-1126-42ed-94de-77e33a16be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:19.994661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa487d4-1126-42ed-94de-77e33a16be6a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:19.995169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa487d4-1126-42ed-94de-77e33a16be6a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:19.995665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa487d4-1126-42ed-94de-77e33a16be6a None admin] PATH_INFO: `/v3/users/d831303efd364cfcb6a31335eaa047b1` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:19.997221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa487d4-1126-42ed-94de-77e33a16be6a None admin] RBAC: Authorizing `identity:get_user(user_id=d831303efd364cfcb6a31335eaa047b1)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:19.998884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa487d4-1126-42ed-94de-77e33a16be6a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:20.001308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 194/362] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:08:19 2022] GET /identity/v3/users/d831303efd364cfcb6a31335eaa047b1 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:20.002772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291532-9ceb-4b03-b620-3d5783d06313 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.003261 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291532-9ceb-4b03-b620-3d5783d06313 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.004347 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51291532-9ceb-4b03-b620-3d5783d06313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.025677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-51291532-9ceb-4b03-b620-3d5783d06313 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:20.027292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-51291532-9ceb-4b03-b620-3d5783d06313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:20.027434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b0e3a-5d54-456a-883a-79c768cb7b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:20.028021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b0e3a-5d54-456a-883a-79c768cb7b5f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.028308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b0e3a-5d54-456a-883a-79c768cb7b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.028587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b0e3a-5d54-456a-883a-79c768cb7b5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.051666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:20.114265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 195/363] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:20.115601 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51291532-9ceb-4b03-b620-3d5783d06313 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:20.121664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b0e3a-5d54-456a-883a-79c768cb7b5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:20.123461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b0e3a-5d54-456a-883a-79c768cb7b5f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:20.187519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:20.224847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51291532-9ceb-4b03-b620-3d5783d06313 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:20.234966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 169/364] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:20.235949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b0e3a-5d54-456a-883a-79c768cb7b5f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:20.265869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5aa08-b016-47c0-803a-ea6452f0a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:20.267587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5aa08-b016-47c0-803a-ea6452f0a5fc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.268071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5aa08-b016-47c0-803a-ea6452f0a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.268586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5aa08-b016-47c0-803a-ea6452f0a5fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.280177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5aa08-b016-47c0-803a-ea6452f0a5fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e2d5aa08-b016-47c0-803a-ea6452f0a5fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:20.290061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:20.290978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:20.291820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:20.294669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 196/365] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:08:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:20.295864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5aa08-b016-47c0-803a-ea6452f0a5fc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:20.314861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:20.348561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b0e3a-5d54-456a-883a-79c768cb7b5f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:20.389915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952e5a6-f795-4550-a501-be44ddf7c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:20.390563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952e5a6-f795-4550-a501-be44ddf7c1cb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.390775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952e5a6-f795-4550-a501-be44ddf7c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.390972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952e5a6-f795-4550-a501-be44ddf7c1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.391876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952e5a6-f795-4550-a501-be44ddf7c1cb None admin] RBAC: Adding query filter params (role.id=aa51c41209054701acd2b9e3bbe58114, user.id=d831303efd364cfcb6a31335eaa047b1, scope.system=all) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:20.392231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952e5a6-f795-4550-a501-be44ddf7c1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:20.393631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952e5a6-f795-4550-a501-be44ddf7c1cb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:20.408036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 170/366] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Jun 7 14:08:20 2022] GET /identity/v3/role_assignments?user.id=d831303efd364cfcb6a31335eaa047b1&scope.system=all&role.id=aa51c41209054701acd2b9e3bbe58114 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:20.408964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952e5a6-f795-4550-a501-be44ddf7c1cb None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:20.413945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5aa08-b016-47c0-803a-ea6452f0a5fc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:20.429727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:20.457955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad3cf6-a151-4eac-b529-2e93997c8d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:20.459244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad3cf6-a151-4eac-b529-2e93997c8d96 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.459884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad3cf6-a151-4eac-b529-2e93997c8d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.460419 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad3cf6-a151-4eac-b529-2e93997c8d96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.473429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad3cf6-a151-4eac-b529-2e93997c8d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-7bad3cf6-a151-4eac-b529-2e93997c8d96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:20.497320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:20.498250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:20.499026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:20.503299 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 197/367] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:20.504660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad3cf6-a151-4eac-b529-2e93997c8d96 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:20.584936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952e5a6-f795-4550-a501-be44ddf7c1cb None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:20.603723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:20.621745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad3cf6-a151-4eac-b529-2e93997c8d96 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:20.632430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670b8d5-f6a0-47dc-b643-bb00466ea2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:20.633323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670b8d5-f6a0-47dc-b643-bb00466ea2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.633611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670b8d5-f6a0-47dc-b643-bb00466ea2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.633894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670b8d5-f6a0-47dc-b643-bb00466ea2b6 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.635165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670b8d5-f6a0-47dc-b643-bb00466ea2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:20.636697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670b8d5-f6a0-47dc-b643-bb00466ea2b6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:20.638914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 171/368] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:20 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:20.639686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670b8d5-f6a0-47dc-b643-bb00466ea2b6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:20.662968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b52a5-4432-4639-81a2-7324454d89aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:20.664120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b52a5-4432-4639-81a2-7324454d89aa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.664734 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b52a5-4432-4639-81a2-7324454d89aa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.665206 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b52a5-4432-4639-81a2-7324454d89aa None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.666219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b52a5-4432-4639-81a2-7324454d89aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:20.666760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b52a5-4432-4639-81a2-7324454d89aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:20.668483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b52a5-4432-4639-81a2-7324454d89aa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:20.678882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 198/369] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:20.680213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b52a5-4432-4639-81a2-7324454d89aa None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:20.742992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:20.761993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670b8d5-f6a0-47dc-b643-bb00466ea2b6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:20.801183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b52a5-4432-4639-81a2-7324454d89aa None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:20.801377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47763fd1-faa9-41e5-b4b5-4c3d70d97ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:20.802004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47763fd1-faa9-41e5-b4b5-4c3d70d97ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.802295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47763fd1-faa9-41e5-b4b5-4c3d70d97ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.802573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47763fd1-faa9-41e5-b4b5-4c3d70d97ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.803368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47763fd1-faa9-41e5-b4b5-4c3d70d97ab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:20.803710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47763fd1-faa9-41e5-b4b5-4c3d70d97ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:20.805119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47763fd1-faa9-41e5-b4b5-4c3d70d97ab6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:20.814321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 172/370] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:20.815223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47763fd1-faa9-41e5-b4b5-4c3d70d97ab6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:20.844409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc45c4-e8c5-4925-bdff-205445488470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:20.845905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc45c4-e8c5-4925-bdff-205445488470 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.846390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc45c4-e8c5-4925-bdff-205445488470 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.846860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc45c4-e8c5-4925-bdff-205445488470 None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.848354 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc45c4-e8c5-4925-bdff-205445488470 None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:20.850287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc45c4-e8c5-4925-bdff-205445488470 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:20.854630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 199/371] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:20 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:20.856066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc45c4-e8c5-4925-bdff-205445488470 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:20.869466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:20.928561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47763fd1-faa9-41e5-b4b5-4c3d70d97ab6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:20.965814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e89c9-d1ac-4252-a777-0a69008ef127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:20.966478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e89c9-d1ac-4252-a777-0a69008ef127 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:20.966766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e89c9-d1ac-4252-a777-0a69008ef127 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:20.967047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e89c9-d1ac-4252-a777-0a69008ef127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:20.972472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc45c4-e8c5-4925-bdff-205445488470 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:20.984424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:21.013908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a89743-8b90-4f3c-acef-4271bace6149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:21.014699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a89743-8b90-4f3c-acef-4271bace6149 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:21.015070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a89743-8b90-4f3c-acef-4271bace6149 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:21.015442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a89743-8b90-4f3c-acef-4271bace6149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:21.045266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e89c9-d1ac-4252-a777-0a69008ef127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:21.046735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e89c9-d1ac-4252-a777-0a69008ef127 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:21.094809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a89743-8b90-4f3c-acef-4271bace6149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:21.096547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a89743-8b90-4f3c-acef-4271bace6149 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:21.099716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:21.162213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 173/372] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:21.163084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e89c9-d1ac-4252-a777-0a69008ef127 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:21.221306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:21.231909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 200/373] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:21.233091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a89743-8b90-4f3c-acef-4271bace6149 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:21.287393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e89c9-d1ac-4252-a777-0a69008ef127 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:21.346028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245daf8-12d6-42d9-b648-68dc1a31f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:21.346952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245daf8-12d6-42d9-b648-68dc1a31f31a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:21.347507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245daf8-12d6-42d9-b648-68dc1a31f31a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:21.347925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245daf8-12d6-42d9-b648-68dc1a31f31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:21.348910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245daf8-12d6-42d9-b648-68dc1a31f31a None admin] RBAC: Adding query filter params (group.id=a7d4397ff5aa4d239492093495d99750, role.id=a284a48d48b2440997815469786a10ec, scope.project.id=309bfab87fbe44008938ccbd283fd590) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:21.349385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245daf8-12d6-42d9-b648-68dc1a31f31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:21.351011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245daf8-12d6-42d9-b648-68dc1a31f31a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:21.357918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 174/374] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:21 2022] GET /identity/v3/role_assignments?group.id=a7d4397ff5aa4d239492093495d99750&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=a284a48d48b2440997815469786a10ec => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:21.359058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245daf8-12d6-42d9-b648-68dc1a31f31a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:21.379276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a89743-8b90-4f3c-acef-4271bace6149 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:21.382019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:21.426932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37474b2-3b6b-4330-aa39-7c3f3d5439fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:21.428386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37474b2-3b6b-4330-aa39-7c3f3d5439fa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:21.428386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37474b2-3b6b-4330-aa39-7c3f3d5439fa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:21.428572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37474b2-3b6b-4330-aa39-7c3f3d5439fa None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:21.429803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37474b2-3b6b-4330-aa39-7c3f3d5439fa None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:21.431468 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37474b2-3b6b-4330-aa39-7c3f3d5439fa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:21.433632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 201/375] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:21 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:21.439153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37474b2-3b6b-4330-aa39-7c3f3d5439fa None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:21.508414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245daf8-12d6-42d9-b648-68dc1a31f31a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:21.522192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:21.564038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491133-4a4b-4abc-b6e6-ce7597ec3b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:21.564519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491133-4a4b-4abc-b6e6-ce7597ec3b5d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:21.564912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491133-4a4b-4abc-b6e6-ce7597ec3b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:21.565278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491133-4a4b-4abc-b6e6-ce7597ec3b5d None admin] PATH_INFO: `/v3/projects/4a7d532589ce43f88947a3878f92cba0` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:21.566729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1491133-4a4b-4abc-b6e6-ce7597ec3b5d None admin] RBAC: Authorizing `identity:get_project(project_id=4a7d532589ce43f88947a3878f92cba0)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:21.568516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1491133-4a4b-4abc-b6e6-ce7597ec3b5d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:21.570714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 175/376] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:21 2022] GET /identity/v3/projects/4a7d532589ce43f88947a3878f92cba0 => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:21.576529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491133-4a4b-4abc-b6e6-ce7597ec3b5d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:21.578310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37474b2-3b6b-4330-aa39-7c3f3d5439fa None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:21.616178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411fff3-dec5-4d50-aa49-ad9268e28da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:21.617475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411fff3-dec5-4d50-aa49-ad9268e28da9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:21.617952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411fff3-dec5-4d50-aa49-ad9268e28da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:21.618444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411fff3-dec5-4d50-aa49-ad9268e28da9 None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:21.620082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411fff3-dec5-4d50-aa49-ad9268e28da9 None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:21.621707 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411fff3-dec5-4d50-aa49-ad9268e28da9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:21.624077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 202/377] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:21 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:21.629528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411fff3-dec5-4d50-aa49-ad9268e28da9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:21.677318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:21.725459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491133-4a4b-4abc-b6e6-ce7597ec3b5d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:21.744853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411fff3-dec5-4d50-aa49-ad9268e28da9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:21.787247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b20e8-3a36-45db-9ac5-efdecca3fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:21.788096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b20e8-3a36-45db-9ac5-efdecca3fab7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:21.788482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b20e8-3a36-45db-9ac5-efdecca3fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:21.788868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b20e8-3a36-45db-9ac5-efdecca3fab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:21.789893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b20e8-3a36-45db-9ac5-efdecca3fab7 None admin] RBAC: Adding query filter params (group.id=a7d4397ff5aa4d239492093495d99750, role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=309bfab87fbe44008938ccbd283fd590) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:21.790208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b20e8-3a36-45db-9ac5-efdecca3fab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:21.791931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b20e8-3a36-45db-9ac5-efdecca3fab7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:21.798983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 203/378] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:21 2022] GET /identity/v3/role_assignments?group.id=a7d4397ff5aa4d239492093495d99750&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:21.809695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d0045-0099-4d84-9abb-bfb65d8c95da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:21.810586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d0045-0099-4d84-9abb-bfb65d8c95da None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:21.810865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d0045-0099-4d84-9abb-bfb65d8c95da None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:21.811141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d0045-0099-4d84-9abb-bfb65d8c95da None admin] PATH_INFO: `/v3/groups/cb2344c6aa194eda8bac1cd0b378e312` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:21.828538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d0045-0099-4d84-9abb-bfb65d8c95da None admin] RBAC: Authorizing `identity:get_group(group_id=cb2344c6aa194eda8bac1cd0b378e312)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:21.829948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d0045-0099-4d84-9abb-bfb65d8c95da None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:21.832134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 176/379] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:21 2022] GET /identity/v3/groups/cb2344c6aa194eda8bac1cd0b378e312 => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:21.837985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b20e8-3a36-45db-9ac5-efdecca3fab7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:21.856540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0eee-1f69-4760-a9ff-6dde62f55dbc None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:21.856865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0eee-1f69-4760-a9ff-6dde62f55dbc None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:21.857097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f0eee-1f69-4760-a9ff-6dde62f55dbc None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:21.858805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 177/380] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:21.865230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d3fe4-a245-4e73-9b10-aafe16096744 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:21.865543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d3fe4-a245-4e73-9b10-aafe16096744 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:21.865789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d3fe4-a245-4e73-9b10-aafe16096744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:21.904792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4a0d3fe4-a245-4e73-9b10-aafe16096744 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:21.906383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4a0d3fe4-a245-4e73-9b10-aafe16096744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:21.989974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:22.018056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b20e8-3a36-45db-9ac5-efdecca3fab7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:22.021325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:22.057079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 178/381] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:22.071517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7fdf0-4e72-4d80-bda1-959ba1f7b39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:22.072213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7fdf0-4e72-4d80-bda1-959ba1f7b39d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:22.072753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7fdf0-4e72-4d80-bda1-959ba1f7b39d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:22.073040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7fdf0-4e72-4d80-bda1-959ba1f7b39d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:22.073898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7fdf0-4e72-4d80-bda1-959ba1f7b39d None admin] RBAC: Adding query filter params (group.id=cb2344c6aa194eda8bac1cd0b378e312, role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=4a7d532589ce43f88947a3878f92cba0) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:22.074211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7fdf0-4e72-4d80-bda1-959ba1f7b39d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:22.075766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7fdf0-4e72-4d80-bda1-959ba1f7b39d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:22.085170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 204/382] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:21 2022] GET /identity/v3/role_assignments?group.id=cb2344c6aa194eda8bac1cd0b378e312&scope.project.id=4a7d532589ce43f88947a3878f92cba0&role.id=c6577847f998435991dac5744a94d0ee => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:22.101488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d3fe4-a245-4e73-9b10-aafe16096744 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:22.214246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d3fe4-a245-4e73-9b10-aafe16096744 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:22.258948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002987-2af8-4905-99b5-80b1e78a29a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:22.260105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002987-2af8-4905-99b5-80b1e78a29a1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:22.260561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002987-2af8-4905-99b5-80b1e78a29a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:22.261030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0002987-2af8-4905-99b5-80b1e78a29a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:22.274486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0002987-2af8-4905-99b5-80b1e78a29a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e0002987-2af8-4905-99b5-80b1e78a29a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:22.282994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:22.283924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:22.284719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:22.287805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 179/383] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:08:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:22.294871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7fdf0-4e72-4d80-bda1-959ba1f7b39d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:22.441650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7fdf0-4e72-4d80-bda1-959ba1f7b39d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:22.482342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9724b-7c27-479a-8c1d-faedba1006c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:22.482342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9724b-7c27-479a-8c1d-faedba1006c1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:22.482342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9724b-7c27-479a-8c1d-faedba1006c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:22.482669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9724b-7c27-479a-8c1d-faedba1006c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:22.483177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9724b-7c27-479a-8c1d-faedba1006c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:22.483541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9724b-7c27-479a-8c1d-faedba1006c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:22.484905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9724b-7c27-479a-8c1d-faedba1006c1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:22.501353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 205/384] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:22.507358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002987-2af8-4905-99b5-80b1e78a29a1 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:22.556494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:22.643703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0002987-2af8-4905-99b5-80b1e78a29a1 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:22.692407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1e891-6d64-41af-815e-bda04ffce93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:22.693221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1e891-6d64-41af-815e-bda04ffce93f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:22.693506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1e891-6d64-41af-815e-bda04ffce93f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:22.693790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1e891-6d64-41af-815e-bda04ffce93f None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:22.695068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1e891-6d64-41af-815e-bda04ffce93f None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:22.696547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1e891-6d64-41af-815e-bda04ffce93f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:22.698747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 180/385] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:22 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:22.704325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9724b-7c27-479a-8c1d-faedba1006c1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:22.755215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:22.848264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9724b-7c27-479a-8c1d-faedba1006c1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:22.897321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99439f19-7cc7-4d62-a3f9-f705bacb23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:22.898182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439f19-7cc7-4d62-a3f9-f705bacb23e3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:22.898462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439f19-7cc7-4d62-a3f9-f705bacb23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:22.898737 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99439f19-7cc7-4d62-a3f9-f705bacb23e3 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:22.900034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439f19-7cc7-4d62-a3f9-f705bacb23e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:22.901463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99439f19-7cc7-4d62-a3f9-f705bacb23e3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:22.903460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 206/386] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:22 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:22.908800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1e891-6d64-41af-815e-bda04ffce93f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:22.921329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a077a-5ded-4378-8e43-829302af1211 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:22.921620 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a077a-5ded-4378-8e43-829302af1211 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:22.921901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a077a-5ded-4378-8e43-829302af1211 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:22.923564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 207/387] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:22.937835 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838739f-ef05-4435-9438-4953eac7c20a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:22.938122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838739f-ef05-4435-9438-4953eac7c20a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:22.938397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838739f-ef05-4435-9438-4953eac7c20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:22.964400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7838739f-ef05-4435-9438-4953eac7c20a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:22.965505 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7838739f-ef05-4435-9438-4953eac7c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:23.049069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:23.053240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1e891-6d64-41af-815e-bda04ffce93f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:23.072077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 208/388] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 07 14:08:23.094756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838739f-ef05-4435-9438-4953eac7c20a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:23.106603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204656-3deb-4b8a-95c6-ccf89db18902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:23.107523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204656-3deb-4b8a-95c6-ccf89db18902 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:23.107810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204656-3deb-4b8a-95c6-ccf89db18902 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:23.108090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204656-3deb-4b8a-95c6-ccf89db18902 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8/groups/a7d4397ff5aa4d239492093495d99750/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:23.113636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b204656-3deb-4b8a-95c6-ccf89db18902 None admin] RBAC: Authorizing `identity:create_grant(project_id=a91db3386fe24593821f7424072923f8, group_id=a7d4397ff5aa4d239492093495d99750, role_id=8b03cb8cbf3248d1a22cd48ec5c21eb6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:23.115083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b204656-3deb-4b8a-95c6-ccf89db18902 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:23.127849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:23.137854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 181/389] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jun 7 14:08:22 2022] PUT /identity/v3/projects/a91db3386fe24593821f7424072923f8/groups/a7d4397ff5aa4d239492093495d99750/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:08:23.225385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838739f-ef05-4435-9438-4953eac7c20a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:23.266870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d8cf8-6d5d-45e8-bc1a-10e1776a67b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:23.267706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d8cf8-6d5d-45e8-bc1a-10e1776a67b9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:23.267995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d8cf8-6d5d-45e8-bc1a-10e1776a67b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:23.268275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d8cf8-6d5d-45e8-bc1a-10e1776a67b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:23.280765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d8cf8-6d5d-45e8-bc1a-10e1776a67b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a62d8cf8-6d5d-45e8-bc1a-10e1776a67b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:23.289370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:23.290304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:23.291656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 209/390] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:23.297040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204656-3deb-4b8a-95c6-ccf89db18902 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:23.435710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204656-3deb-4b8a-95c6-ccf89db18902 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:23.478011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce88d5-afbf-4d3c-aac5-6781e7033605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:23.478611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce88d5-afbf-4d3c-aac5-6781e7033605 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:23.478899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce88d5-afbf-4d3c-aac5-6781e7033605 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:23.479176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce88d5-afbf-4d3c-aac5-6781e7033605 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:23.479989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce88d5-afbf-4d3c-aac5-6781e7033605 None admin] RBAC: Adding query filter params (name=member) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:23.480299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce88d5-afbf-4d3c-aac5-6781e7033605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:23.481671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce88d5-afbf-4d3c-aac5-6781e7033605 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:23.501700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 182/391] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:23.508018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d8cf8-6d5d-45e8-bc1a-10e1776a67b9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:23.613946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:23.634140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d8cf8-6d5d-45e8-bc1a-10e1776a67b9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:23.682404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2c4ab-8056-41a9-b63b-b54dcb75534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:23.683281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2c4ab-8056-41a9-b63b-b54dcb75534a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:23.683592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2c4ab-8056-41a9-b63b-b54dcb75534a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:23.683868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2c4ab-8056-41a9-b63b-b54dcb75534a None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:23.685246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2c4ab-8056-41a9-b63b-b54dcb75534a None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:23.686712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2c4ab-8056-41a9-b63b-b54dcb75534a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:23.692409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 210/392] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:23 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:23.698136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce88d5-afbf-4d3c-aac5-6781e7033605 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:23.742337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:23.866850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce88d5-afbf-4d3c-aac5-6781e7033605 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:23.921719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefe6f2-7117-43b1-a674-0a46c99e678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:23.922649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefe6f2-7117-43b1-a674-0a46c99e678f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:23.922933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefe6f2-7117-43b1-a674-0a46c99e678f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:23.923208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefe6f2-7117-43b1-a674-0a46c99e678f None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:23.924517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefe6f2-7117-43b1-a674-0a46c99e678f None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:23.926011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefe6f2-7117-43b1-a674-0a46c99e678f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:23.927870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 183/393] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:23 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:23.933634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2c4ab-8056-41a9-b63b-b54dcb75534a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:24.089332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2c4ab-8056-41a9-b63b-b54dcb75534a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:24.139480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b6e81-101c-4751-83d3-59c674012295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:24.140383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b6e81-101c-4751-83d3-59c674012295 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:24.140670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b6e81-101c-4751-83d3-59c674012295 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:24.140950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b6e81-101c-4751-83d3-59c674012295 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8/groups/a7d4397ff5aa4d239492093495d99750/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:24.142969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b6e81-101c-4751-83d3-59c674012295 None admin] RBAC: Authorizing `identity:create_grant(project_id=a91db3386fe24593821f7424072923f8, group_id=a7d4397ff5aa4d239492093495d99750, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:24.144998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b6e81-101c-4751-83d3-59c674012295 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:24.162616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 211/394] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jun 7 14:08:23 2022] PUT /identity/v3/projects/a91db3386fe24593821f7424072923f8/groups/a7d4397ff5aa4d239492093495d99750/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:24.719177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72236d5d-6f71-4734-9a30-8c145213cf50 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:24.719696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72236d5d-6f71-4734-9a30-8c145213cf50 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:24.719771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72236d5d-6f71-4734-9a30-8c145213cf50 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:24.721406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 184/395] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:24.727564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d501-b5e7-40b2-9df7-4c96d2b7e881 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:24.727987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d501-b5e7-40b2-9df7-4c96d2b7e881 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:24.728181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3d501-b5e7-40b2-9df7-4c96d2b7e881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:24.748673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-37e3d501-b5e7-40b2-9df7-4c96d2b7e881 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:24.749859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-37e3d501-b5e7-40b2-9df7-4c96d2b7e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:24.762019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:24.844637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 212/396] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:24.884721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72236d5d-6f71-4734-9a30-8c145213cf50 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:24.906594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd97603-8436-4863-8216-22d4b32b26ba None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:24.906884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd97603-8436-4863-8216-22d4b32b26ba None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:24.907166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd97603-8436-4863-8216-22d4b32b26ba None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:24.908585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 213/397] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:24.924864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1599da-a8cd-4a67-a1a1-993ccf74b4c5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:24.925178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1599da-a8cd-4a67-a1a1-993ccf74b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:24.925476 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1599da-a8cd-4a67-a1a1-993ccf74b4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:24.949224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-df1599da-a8cd-4a67-a1a1-993ccf74b4c5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:24.953969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-df1599da-a8cd-4a67-a1a1-993ccf74b4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:25.045736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:25.061320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72236d5d-6f71-4734-9a30-8c145213cf50 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:25.096092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 214/398] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:25.117941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5c19d-5be4-4b56-a311-8cdf251f2704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:25.118753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5c19d-5be4-4b56-a311-8cdf251f2704 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.119033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5c19d-5be4-4b56-a311-8cdf251f2704 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.119386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5c19d-5be4-4b56-a311-8cdf251f2704 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.120070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1599da-a8cd-4a67-a1a1-993ccf74b4c5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:25.130578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5c19d-5be4-4b56-a311-8cdf251f2704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-eba5c19d-5be4-4b56-a311-8cdf251f2704 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:25.140066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:25.140969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:25.141965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 185/399] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:25.147899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5c19d-5be4-4b56-a311-8cdf251f2704 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:25.256965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5c19d-5be4-4b56-a311-8cdf251f2704 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:25.292155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:25.298330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800a32-5ed1-48d7-806c-32b91e332f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:25.298950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800a32-5ed1-48d7-806c-32b91e332f96 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.299238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800a32-5ed1-48d7-806c-32b91e332f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.299550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800a32-5ed1-48d7-806c-32b91e332f96 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.300505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800a32-5ed1-48d7-806c-32b91e332f96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:25.300817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800a32-5ed1-48d7-806c-32b91e332f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:25.302893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800a32-5ed1-48d7-806c-32b91e332f96 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:25.315511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 186/400] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:25.318652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eda73c-fb6b-41ef-bdba-04e6fb0db548 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.319819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eda73c-fb6b-41ef-bdba-04e6fb0db548 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.320436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eda73c-fb6b-41ef-bdba-04e6fb0db548 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.323385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 187/401] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:25.325714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eda73c-fb6b-41ef-bdba-04e6fb0db548 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:25.337323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1599da-a8cd-4a67-a1a1-993ccf74b4c5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:25.345442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:25.397631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba560c-debd-417f-be2a-a865794bd4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:25.398455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba560c-debd-417f-be2a-a865794bd4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.398735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba560c-debd-417f-be2a-a865794bd4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.399007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba560c-debd-417f-be2a-a865794bd4e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.409969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba560c-debd-417f-be2a-a865794bd4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e2ba560c-debd-417f-be2a-a865794bd4e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:25.418263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:25.419195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:25.420054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:25.420658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 215/402] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:08:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:25.421803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3922661-dee5-4917-bc85-7c9e6490480d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.422092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3922661-dee5-4917-bc85-7c9e6490480d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.422368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3922661-dee5-4917-bc85-7c9e6490480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.439818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a3922661-dee5-4917-bc85-7c9e6490480d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:25.441624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a3922661-dee5-4917-bc85-7c9e6490480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:25.475017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eda73c-fb6b-41ef-bdba-04e6fb0db548 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:25.521164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019dd9d2-7ce0-4962-94e9-fcc5119a64c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:25.522196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019dd9d2-7ce0-4962-94e9-fcc5119a64c2 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.522490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019dd9d2-7ce0-4962-94e9-fcc5119a64c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.522761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019dd9d2-7ce0-4962-94e9-fcc5119a64c2 None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.524399 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019dd9d2-7ce0-4962-94e9-fcc5119a64c2 None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:25.525987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019dd9d2-7ce0-4962-94e9-fcc5119a64c2 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:25.527814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 188/403] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:25 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:25.528670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019dd9d2-7ce0-4962-94e9-fcc5119a64c2 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:25.549439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 216/404] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:25.552076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3922661-dee5-4917-bc85-7c9e6490480d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:25.643076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:25.649782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:25.678128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019dd9d2-7ce0-4962-94e9-fcc5119a64c2 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:25.689570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3922661-dee5-4917-bc85-7c9e6490480d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:25.719323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a7ef4-d4d7-457c-a9cf-698f7584262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:25.720028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a7ef4-d4d7-457c-a9cf-698f7584262c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.720313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a7ef4-d4d7-457c-a9cf-698f7584262c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.720589 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a7ef4-d4d7-457c-a9cf-698f7584262c None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.721345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a7ef4-d4d7-457c-a9cf-698f7584262c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:25.721668 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a7ef4-d4d7-457c-a9cf-698f7584262c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:25.723436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a7ef4-d4d7-457c-a9cf-698f7584262c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:25.733011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 189/405] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:25.735081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a7ef4-d4d7-457c-a9cf-698f7584262c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:25.736283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fecced-6e52-4538-b11e-e65aee8547a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:25.738535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fecced-6e52-4538-b11e-e65aee8547a7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.739026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fecced-6e52-4538-b11e-e65aee8547a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.740424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fecced-6e52-4538-b11e-e65aee8547a7 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.741962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fecced-6e52-4538-b11e-e65aee8547a7 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:25.743687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fecced-6e52-4538-b11e-e65aee8547a7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:25.746508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 217/406] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:25 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:25.748001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fecced-6e52-4538-b11e-e65aee8547a7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:25.856504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a7ef4-d4d7-457c-a9cf-698f7584262c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:25.896270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fecced-6e52-4538-b11e-e65aee8547a7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:25.900817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977f444-4a45-4a7f-b83d-2987ae3e4a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:25.901878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977f444-4a45-4a7f-b83d-2987ae3e4a0a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.902365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977f444-4a45-4a7f-b83d-2987ae3e4a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.902860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977f444-4a45-4a7f-b83d-2987ae3e4a0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.918150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977f444-4a45-4a7f-b83d-2987ae3e4a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-4977f444-4a45-4a7f-b83d-2987ae3e4a0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:25.930637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:25.931577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:25.932396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:25.933032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 190/407] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:08:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:25.934203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977f444-4a45-4a7f-b83d-2987ae3e4a0a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:25.936013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c6d03-9c3c-47dd-9075-e08bfebd9736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:25.936875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6d03-9c3c-47dd-9075-e08bfebd9736 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:25.937313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6d03-9c3c-47dd-9075-e08bfebd9736 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:25.937590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c6d03-9c3c-47dd-9075-e08bfebd9736 None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:25.940092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c6d03-9c3c-47dd-9075-e08bfebd9736 None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:25.941588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:25.947051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c6d03-9c3c-47dd-9075-e08bfebd9736 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:25.950603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 218/408] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:25 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:25.952260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c6d03-9c3c-47dd-9075-e08bfebd9736 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:25.956367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:26.058540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977f444-4a45-4a7f-b83d-2987ae3e4a0a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:26.063353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c6d03-9c3c-47dd-9075-e08bfebd9736 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:26.093462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfe75e-15ef-4ec3-8c0f-bbc794c21dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:26.094343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfe75e-15ef-4ec3-8c0f-bbc794c21dfe None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.094625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfe75e-15ef-4ec3-8c0f-bbc794c21dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.094899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfe75e-15ef-4ec3-8c0f-bbc794c21dfe None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590/groups/a7d4397ff5aa4d239492093495d99750/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.096901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfe75e-15ef-4ec3-8c0f-bbc794c21dfe None admin] RBAC: Authorizing `identity:create_grant(project_id=309bfab87fbe44008938ccbd283fd590, group_id=a7d4397ff5aa4d239492093495d99750, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:26.098838 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cfe75e-15ef-4ec3-8c0f-bbc794c21dfe None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:26.100493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92809a3-9f66-42ad-81a2-11615734bfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:26.101157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92809a3-9f66-42ad-81a2-11615734bfcc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.101442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92809a3-9f66-42ad-81a2-11615734bfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.102123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92809a3-9f66-42ad-81a2-11615734bfcc None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.102472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92809a3-9f66-42ad-81a2-11615734bfcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:26.102904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92809a3-9f66-42ad-81a2-11615734bfcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:26.104258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92809a3-9f66-42ad-81a2-11615734bfcc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:26.115097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 219/409] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:26.115784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92809a3-9f66-42ad-81a2-11615734bfcc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:26.120314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 191/410] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jun 7 14:08:25 2022] PUT /identity/v3/projects/309bfab87fbe44008938ccbd283fd590/groups/a7d4397ff5aa4d239492093495d99750/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:26.121481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea284e3-083a-4e16-8f41-79cdf4f12f58 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.121773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea284e3-083a-4e16-8f41-79cdf4f12f58 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.122048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea284e3-083a-4e16-8f41-79cdf4f12f58 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.123517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 192/411] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:26.128457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea284e3-083a-4e16-8f41-79cdf4f12f58 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:26.195649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:26.202175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:26.248745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92809a3-9f66-42ad-81a2-11615734bfcc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:26.255426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea284e3-083a-4e16-8f41-79cdf4f12f58 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:26.296170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f9377-8663-4d30-89d6-0145c462f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:26.296417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27742e50-9759-4811-9866-f1a9e5d80a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:26.297159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f9377-8663-4d30-89d6-0145c462f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.297510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f9377-8663-4d30-89d6-0145c462f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.297854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f9377-8663-4d30-89d6-0145c462f8d0 None admin] PATH_INFO: `/v3/groups/cb2344c6aa194eda8bac1cd0b378e312` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.298140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742e50-9759-4811-9866-f1a9e5d80a3a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.298706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742e50-9759-4811-9866-f1a9e5d80a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.299157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742e50-9759-4811-9866-f1a9e5d80a3a None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.299482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f9377-8663-4d30-89d6-0145c462f8d0 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2344c6aa194eda8bac1cd0b378e312)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:26.301437 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27742e50-9759-4811-9866-f1a9e5d80a3a None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:26.301726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f9377-8663-4d30-89d6-0145c462f8d0 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:26.303430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27742e50-9759-4811-9866-f1a9e5d80a3a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:26.305970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 220/412] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:26 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:26.307559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa05da-53cf-4e89-a721-e70a7ac0b0f1 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.308293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 193/413] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:26 2022] GET /identity/v3/groups/cb2344c6aa194eda8bac1cd0b378e312 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:26.308619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa05da-53cf-4e89-a721-e70a7ac0b0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.309095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa05da-53cf-4e89-a721-e70a7ac0b0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.309418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f9377-8663-4d30-89d6-0145c462f8d0 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:26.332236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5afa05da-53cf-4e89-a721-e70a7ac0b0f1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:26.333764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5afa05da-53cf-4e89-a721-e70a7ac0b0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:26.420892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 221/414] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:26.422066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa05da-53cf-4e89-a721-e70a7ac0b0f1 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:26.444428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f9377-8663-4d30-89d6-0145c462f8d0 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:26.498195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:26.505679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917da484-fcc0-4c3c-89c2-f93ffa6e96af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:26.506830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da484-fcc0-4c3c-89c2-f93ffa6e96af None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.507373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da484-fcc0-4c3c-89c2-f93ffa6e96af None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.507853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da484-fcc0-4c3c-89c2-f93ffa6e96af None admin] PATH_INFO: `/v3/projects/4a7d532589ce43f88947a3878f92cba0` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.509340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917da484-fcc0-4c3c-89c2-f93ffa6e96af None admin] RBAC: Authorizing `identity:get_project(project_id=4a7d532589ce43f88947a3878f92cba0)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:26.510360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:26.511381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917da484-fcc0-4c3c-89c2-f93ffa6e96af None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:26.513526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 194/415] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:26 2022] GET /identity/v3/projects/4a7d532589ce43f88947a3878f92cba0 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:26.514498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917da484-fcc0-4c3c-89c2-f93ffa6e96af None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:26.569058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa05da-53cf-4e89-a721-e70a7ac0b0f1 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:26.617147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5124b51-148f-4166-a882-61a65c7a1e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:26.618339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5124b51-148f-4166-a882-61a65c7a1e9b None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.618640 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5124b51-148f-4166-a882-61a65c7a1e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.618922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5124b51-148f-4166-a882-61a65c7a1e9b None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590/groups/a7d4397ff5aa4d239492093495d99750/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.622270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5124b51-148f-4166-a882-61a65c7a1e9b None admin] RBAC: Authorizing `identity:create_grant(project_id=309bfab87fbe44008938ccbd283fd590, group_id=a7d4397ff5aa4d239492093495d99750, role_id=8b03cb8cbf3248d1a22cd48ec5c21eb6)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:26.624196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5124b51-148f-4166-a882-61a65c7a1e9b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:26.629150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917da484-fcc0-4c3c-89c2-f93ffa6e96af None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:26.648878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 222/416] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jun 7 14:08:26 2022] PUT /identity/v3/projects/309bfab87fbe44008938ccbd283fd590/groups/a7d4397ff5aa4d239492093495d99750/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:26.650105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5124b51-148f-4166-a882-61a65c7a1e9b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:26.684607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb90a9-ad4c-4cdb-aa69-557b3cead195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:26.684607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb90a9-ad4c-4cdb-aa69-557b3cead195 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.684607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb90a9-ad4c-4cdb-aa69-557b3cead195 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.684607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb90a9-ad4c-4cdb-aa69-557b3cead195 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.697903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb90a9-ad4c-4cdb-aa69-557b3cead195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-d0eb90a9-ad4c-4cdb-aa69-557b3cead195 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:26.708096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:26.709090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:26.709966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:26.710560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 195/417] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:08:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:26.717240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb90a9-ad4c-4cdb-aa69-557b3cead195 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:26.792276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:26.844274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb90a9-ad4c-4cdb-aa69-557b3cead195 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:26.867923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5124b51-148f-4166-a882-61a65c7a1e9b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:26.885868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b81b5b-aeef-4799-8492-c4c29102712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:26.886549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b81b5b-aeef-4799-8492-c4c29102712a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.886998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b81b5b-aeef-4799-8492-c4c29102712a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.887284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b81b5b-aeef-4799-8492-c4c29102712a None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.888370 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b81b5b-aeef-4799-8492-c4c29102712a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:26.888681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b81b5b-aeef-4799-8492-c4c29102712a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:26.890062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b81b5b-aeef-4799-8492-c4c29102712a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:26.899812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:26.905167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 196/418] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:26.908387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f523a7-a226-4e6f-9b2f-5cb360745ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:26.909040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b81b5b-aeef-4799-8492-c4c29102712a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:26.909278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f523a7-a226-4e6f-9b2f-5cb360745ee8 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:26.909591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f523a7-a226-4e6f-9b2f-5cb360745ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:26.909868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f523a7-a226-4e6f-9b2f-5cb360745ee8 None admin] PATH_INFO: `/v3/projects/4a7d532589ce43f88947a3878f92cba0/groups/cb2344c6aa194eda8bac1cd0b378e312/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:26.911960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f523a7-a226-4e6f-9b2f-5cb360745ee8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a7d532589ce43f88947a3878f92cba0, group_id=cb2344c6aa194eda8bac1cd0b378e312, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:26.913500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f523a7-a226-4e6f-9b2f-5cb360745ee8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:26.932191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 223/419] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jun 7 14:08:26 2022] PUT /identity/v3/projects/4a7d532589ce43f88947a3878f92cba0/groups/cb2344c6aa194eda8bac1cd0b378e312/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:27.024232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b81b5b-aeef-4799-8492-c4c29102712a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:27.034195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0353c0-87fb-4729-96be-f2c8c36a6900 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:27.034548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0353c0-87fb-4729-96be-f2c8c36a6900 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:27.035194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0353c0-87fb-4729-96be-f2c8c36a6900 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:27.036724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 224/420] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:27.043981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d1b8d-eff0-4af5-b7d5-538bf62ba93b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:27.044384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d1b8d-eff0-4af5-b7d5-538bf62ba93b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:27.044660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d1b8d-eff0-4af5-b7d5-538bf62ba93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:27.051840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:27.075022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f94d1b8d-eff0-4af5-b7d5-538bf62ba93b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:27.075022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f94d1b8d-eff0-4af5-b7d5-538bf62ba93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:27.084354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca79c29-6bf5-46aa-b6a2-4f3b3acdb1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:27.085418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79c29-6bf5-46aa-b6a2-4f3b3acdb1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:27.085912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79c29-6bf5-46aa-b6a2-4f3b3acdb1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:27.086422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79c29-6bf5-46aa-b6a2-4f3b3acdb1a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:27.189083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 225/421] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:27.209951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca79c29-6bf5-46aa-b6a2-4f3b3acdb1a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:27.211421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca79c29-6bf5-46aa-b6a2-4f3b3acdb1a3 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:27.216042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d1b8d-eff0-4af5-b7d5-538bf62ba93b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:27.329685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d1b8d-eff0-4af5-b7d5-538bf62ba93b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:27.336081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 197/422] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:27.340387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca79c29-6bf5-46aa-b6a2-4f3b3acdb1a3 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:27.379702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:27.383774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:27.425666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b0de-3799-4b03-8654-8e745397fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:27.426472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b0de-3799-4b03-8654-8e745397fd16 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:27.426748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b0de-3799-4b03-8654-8e745397fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:27.427016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b0de-3799-4b03-8654-8e745397fd16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:27.450436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45b0de-3799-4b03-8654-8e745397fd16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ec45b0de-3799-4b03-8654-8e745397fd16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:27.458521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:27.459461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:27.460286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 226/423] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:27.466327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b0de-3799-4b03-8654-8e745397fd16 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:27.502618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca79c29-6bf5-46aa-b6a2-4f3b3acdb1a3 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:27.568564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8884b7-2753-4c0c-9618-6c5fb7778f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:27.573589 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8884b7-2753-4c0c-9618-6c5fb7778f59 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:27.574096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8884b7-2753-4c0c-9618-6c5fb7778f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:27.574577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8884b7-2753-4c0c-9618-6c5fb7778f59 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:27.576036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8884b7-2753-4c0c-9618-6c5fb7778f59 None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:27.577684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8884b7-2753-4c0c-9618-6c5fb7778f59 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:27.579954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 198/424] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:27 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:27.585467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8884b7-2753-4c0c-9618-6c5fb7778f59 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:27.687735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:27.689685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b0de-3799-4b03-8654-8e745397fd16 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:27.697676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8884b7-2753-4c0c-9618-6c5fb7778f59 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:27.735401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b40c-3715-4954-98ed-6d7bbbcc4973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:27.736605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b40c-3715-4954-98ed-6d7bbbcc4973 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:27.737104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b40c-3715-4954-98ed-6d7bbbcc4973 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:27.737487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b40c-3715-4954-98ed-6d7bbbcc4973 None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:27.739396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4b40c-3715-4954-98ed-6d7bbbcc4973 None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:27.741391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c4b40c-3715-4954-98ed-6d7bbbcc4973 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:27.743717 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 199/425] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:27 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:27.752649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b40c-3715-4954-98ed-6d7bbbcc4973 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:27.768390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6a8f8-4982-458a-8643-7805a05c61bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:27.769133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6a8f8-4982-458a-8643-7805a05c61bf None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:27.769420 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6a8f8-4982-458a-8643-7805a05c61bf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:27.769706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6a8f8-4982-458a-8643-7805a05c61bf None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:27.770466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6a8f8-4982-458a-8643-7805a05c61bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:27.770781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6a8f8-4982-458a-8643-7805a05c61bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:27.772194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf6a8f8-4982-458a-8643-7805a05c61bf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:27.790454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 227/426] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:27.795905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6a8f8-4982-458a-8643-7805a05c61bf None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:27.860096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:27.905515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b40c-3715-4954-98ed-6d7bbbcc4973 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:27.972924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a44d-fc5d-42f0-8afc-37f47bd70a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:27.974129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a44d-fc5d-42f0-8afc-37f47bd70a61 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:27.976188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6a8f8-4982-458a-8643-7805a05c61bf None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:27.977017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a44d-fc5d-42f0-8afc-37f47bd70a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:27.978815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a44d-fc5d-42f0-8afc-37f47bd70a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:27.979891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a44d-fc5d-42f0-8afc-37f47bd70a61 None admin] RBAC: Adding query filter params (group.id=a7d4397ff5aa4d239492093495d99750, role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=a91db3386fe24593821f7424072923f8) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:27.980605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a44d-fc5d-42f0-8afc-37f47bd70a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:27.982913 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a44d-fc5d-42f0-8afc-37f47bd70a61 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:27.995272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 200/427] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:27 2022] GET /identity/v3/role_assignments?group.id=a7d4397ff5aa4d239492093495d99750&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:28.025302 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079515f-2f52-4b44-a471-072ac21e0bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:28.026330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079515f-2f52-4b44-a471-072ac21e0bdf None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:28.026829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079515f-2f52-4b44-a471-072ac21e0bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:28.027317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079515f-2f52-4b44-a471-072ac21e0bdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:28.127242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079515f-2f52-4b44-a471-072ac21e0bdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:28.129090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079515f-2f52-4b44-a471-072ac21e0bdf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:28.171777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:28.265015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 228/428] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:08:28.271503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a44d-fc5d-42f0-8afc-37f47bd70a61 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:28.299239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:28.404270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a44d-fc5d-42f0-8afc-37f47bd70a61 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:28.439508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b5bdf-d433-4c2b-9a0b-f230c52bf448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:28.441263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b5bdf-d433-4c2b-9a0b-f230c52bf448 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:28.441761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b5bdf-d433-4c2b-9a0b-f230c52bf448 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:28.442233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b5bdf-d433-4c2b-9a0b-f230c52bf448 None admin] PATH_INFO: `/v3/projects/a91db3386fe24593821f7424072923f8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:28.443647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b5bdf-d433-4c2b-9a0b-f230c52bf448 None admin] RBAC: Authorizing `identity:get_project(project_id=a91db3386fe24593821f7424072923f8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:28.445253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b5bdf-d433-4c2b-9a0b-f230c52bf448 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:28.447704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 201/429] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:28 2022] GET /identity/v3/projects/a91db3386fe24593821f7424072923f8 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:28.453236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079515f-2f52-4b44-a471-072ac21e0bdf None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:28.573412 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079515f-2f52-4b44-a471-072ac21e0bdf None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:28.613968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebe01c-18f7-4faa-881e-149ebfdc78ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:28.615190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebe01c-18f7-4faa-881e-149ebfdc78ed None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:28.615712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebe01c-18f7-4faa-881e-149ebfdc78ed None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:28.616179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebe01c-18f7-4faa-881e-149ebfdc78ed None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:28.617552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebe01c-18f7-4faa-881e-149ebfdc78ed None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:28.619171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebe01c-18f7-4faa-881e-149ebfdc78ed None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:28.621316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 229/430] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:28 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:28.627176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b5bdf-d433-4c2b-9a0b-f230c52bf448 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:28.725375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3acb0c-eee1-4d92-86cc-7d68cb71f4bb None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:28.725975 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3acb0c-eee1-4d92-86cc-7d68cb71f4bb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:28.726463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3acb0c-eee1-4d92-86cc-7d68cb71f4bb None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:28.728260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 230/431] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:28.731760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:28.734275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226be25-3259-4ccc-b406-6277584d32b7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:28.734690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226be25-3259-4ccc-b406-6277584d32b7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:28.734978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226be25-3259-4ccc-b406-6277584d32b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:28.741041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:28.746565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b5bdf-d433-4c2b-9a0b-f230c52bf448 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:28.754294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6226be25-3259-4ccc-b406-6277584d32b7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:28.755803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6226be25-3259-4ccc-b406-6277584d32b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:28.782576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea319bcf-c894-44b2-b4e1-727e2e1b4a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:28.783666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea319bcf-c894-44b2-b4e1-727e2e1b4a0f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:28.784145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea319bcf-c894-44b2-b4e1-727e2e1b4a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:28.785255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea319bcf-c894-44b2-b4e1-727e2e1b4a0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:28.786391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea319bcf-c894-44b2-b4e1-727e2e1b4a0f None admin] RBAC: Adding query filter params (group.id=a7d4397ff5aa4d239492093495d99750, role.id=a284a48d48b2440997815469786a10ec, scope.project.id=a91db3386fe24593821f7424072923f8) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:28.786994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea319bcf-c894-44b2-b4e1-727e2e1b4a0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:28.788634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea319bcf-c894-44b2-b4e1-727e2e1b4a0f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:28.795472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 202/432] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:28 2022] GET /identity/v3/role_assignments?group.id=a7d4397ff5aa4d239492093495d99750&scope.project.id=a91db3386fe24593821f7424072923f8&role.id=a284a48d48b2440997815469786a10ec => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:28.840193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 231/433] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:28.864881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea319bcf-c894-44b2-b4e1-727e2e1b4a0f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:28.984472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea319bcf-c894-44b2-b4e1-727e2e1b4a0f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:29.024814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a99936-58ad-4b22-af0c-2ba2cf5fe84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:29.025669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a99936-58ad-4b22-af0c-2ba2cf5fe84b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.025950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a99936-58ad-4b22-af0c-2ba2cf5fe84b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.026218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a99936-58ad-4b22-af0c-2ba2cf5fe84b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.037475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a99936-58ad-4b22-af0c-2ba2cf5fe84b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-06a99936-58ad-4b22-af0c-2ba2cf5fe84b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:29.045207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:29.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:29.046950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 203/434] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:29.052292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226be25-3259-4ccc-b406-6277584d32b7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:29.164238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226be25-3259-4ccc-b406-6277584d32b7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:29.195171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:29.201539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc90b8-29bc-4b1b-9c8b-4c3325515e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:29.202216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc90b8-29bc-4b1b-9c8b-4c3325515e76 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.202511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc90b8-29bc-4b1b-9c8b-4c3325515e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.202770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc90b8-29bc-4b1b-9c8b-4c3325515e76 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.203566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc90b8-29bc-4b1b-9c8b-4c3325515e76 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:29.203871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc90b8-29bc-4b1b-9c8b-4c3325515e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:29.205334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc90b8-29bc-4b1b-9c8b-4c3325515e76 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:29.215277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 232/435] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:08:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:29.221121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a99936-58ad-4b22-af0c-2ba2cf5fe84b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:29.238012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:29.295784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860033-2f9d-495a-9a93-8ee148f0b888 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.296073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860033-2f9d-495a-9a93-8ee148f0b888 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.296358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860033-2f9d-495a-9a93-8ee148f0b888 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.297930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 233/436] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:29.303877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bc38-9471-43db-a588-580573783867 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.303877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bc38-9471-43db-a588-580573783867 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.303877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bc38-9471-43db-a588-580573783867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.324691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-44e2bc38-9471-43db-a588-580573783867 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:29.325872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-44e2bc38-9471-43db-a588-580573783867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:29.350711 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a99936-58ad-4b22-af0c-2ba2cf5fe84b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:29.397326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f88df-4206-43e2-8cc1-0730a9a623fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:29.398437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f88df-4206-43e2-8cc1-0730a9a623fb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.398910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f88df-4206-43e2-8cc1-0730a9a623fb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.399278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f88df-4206-43e2-8cc1-0730a9a623fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.425840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 234/437] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:29.450314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2bc38-9471-43db-a588-580573783867 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:29.494458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f88df-4206-43e2-8cc1-0730a9a623fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:29.494458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f88df-4206-43e2-8cc1-0730a9a623fb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:29.511684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:29.598512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2bc38-9471-43db-a588-580573783867 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:29.625974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 204/438] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:08:29.626368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:29.632436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f88df-4206-43e2-8cc1-0730a9a623fb None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:29.639272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05092c0d-ce11-4fa6-9795-440649d70b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:29.640119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05092c0d-ce11-4fa6-9795-440649d70b2e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.640921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05092c0d-ce11-4fa6-9795-440649d70b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.641203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05092c0d-ce11-4fa6-9795-440649d70b2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.652692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05092c0d-ce11-4fa6-9795-440649d70b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-05092c0d-ce11-4fa6-9795-440649d70b2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:29.661059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:29.661942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:29.662739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 235/439] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:08:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:29.668118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05092c0d-ce11-4fa6-9795-440649d70b2e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:29.744222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f88df-4206-43e2-8cc1-0730a9a623fb None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:29.757642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:29.769514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05092c0d-ce11-4fa6-9795-440649d70b2e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:29.778685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca5e36-6c59-4083-a21f-dc7c3572a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:29.779564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5e36-6c59-4083-a21f-dc7c3572a089 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.779843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5e36-6c59-4083-a21f-dc7c3572a089 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.780112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca5e36-6c59-4083-a21f-dc7c3572a089 None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.781283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca5e36-6c59-4083-a21f-dc7c3572a089 None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:29.782712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca5e36-6c59-4083-a21f-dc7c3572a089 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:29.784969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 205/440] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:29 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:29.786104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedf8ba-ef32-4d5c-a61c-01a813614da5 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.786380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedf8ba-ef32-4d5c-a61c-01a813614da5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.786657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedf8ba-ef32-4d5c-a61c-01a813614da5 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.787880 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 206/441] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:29.790132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedf8ba-ef32-4d5c-a61c-01a813614da5 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:29.804183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd7a2a-2012-48a7-8114-82ad3ab08696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:29.804850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd7a2a-2012-48a7-8114-82ad3ab08696 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.805134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd7a2a-2012-48a7-8114-82ad3ab08696 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.805452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd7a2a-2012-48a7-8114-82ad3ab08696 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.806204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd7a2a-2012-48a7-8114-82ad3ab08696 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:29.806511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd7a2a-2012-48a7-8114-82ad3ab08696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:29.807933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd7a2a-2012-48a7-8114-82ad3ab08696 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:29.815709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 236/442] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:29.815709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca0103-598e-4b19-b610-e90a5bf8c16e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.815709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca0103-598e-4b19-b610-e90a5bf8c16e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.815709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca0103-598e-4b19-b610-e90a5bf8c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.833905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a2ca0103-598e-4b19-b610-e90a5bf8c16e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:29.835173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a2ca0103-598e-4b19-b610-e90a5bf8c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:29.877456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:29.891257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedf8ba-ef32-4d5c-a61c-01a813614da5 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:29.900858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 237/443] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:29.901826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca0103-598e-4b19-b610-e90a5bf8c16e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:29.931098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d31019-19d0-475b-bb05-d1e978123938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:29.931980 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d31019-19d0-475b-bb05-d1e978123938 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:29.932350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d31019-19d0-475b-bb05-d1e978123938 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:29.932528 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d31019-19d0-475b-bb05-d1e978123938 None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:29.933930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d31019-19d0-475b-bb05-d1e978123938 None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:29.935430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d31019-19d0-475b-bb05-d1e978123938 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:29.937030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 207/444] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:29 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:29.940188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d31019-19d0-475b-bb05-d1e978123938 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:29.988568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:30.013721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca0103-598e-4b19-b610-e90a5bf8c16e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:30.037911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d31019-19d0-475b-bb05-d1e978123938 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:30.046169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26838aa8-404a-4108-af49-ae8e76272cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:30.046823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26838aa8-404a-4108-af49-ae8e76272cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:30.047113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26838aa8-404a-4108-af49-ae8e76272cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:30.047423 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26838aa8-404a-4108-af49-ae8e76272cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:30.071305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fb36c-dcc6-49c0-8b7f-dc88b5d129ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:30.072147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb36c-dcc6-49c0-8b7f-dc88b5d129ec None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:30.072695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb36c-dcc6-49c0-8b7f-dc88b5d129ec None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:30.072981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fb36c-dcc6-49c0-8b7f-dc88b5d129ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:30.083024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fb36c-dcc6-49c0-8b7f-dc88b5d129ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-b65fb36c-dcc6-49c0-8b7f-dc88b5d129ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:30.090753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:30.091771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 208/445] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:08:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:30.093263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fb36c-dcc6-49c0-8b7f-dc88b5d129ec None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:30.094536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:30.115986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26838aa8-404a-4108-af49-ae8e76272cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:30.117421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26838aa8-404a-4108-af49-ae8e76272cc4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:30.194951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fb36c-dcc6-49c0-8b7f-dc88b5d129ec None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:30.203784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:30.214299 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 238/446] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:30.215114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26838aa8-404a-4108-af49-ae8e76272cc4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:30.233789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511197b7-33c8-41c8-a76d-d73da1a8cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:30.234448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511197b7-33c8-41c8-a76d-d73da1a8cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:30.234722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511197b7-33c8-41c8-a76d-d73da1a8cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:30.234995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511197b7-33c8-41c8-a76d-d73da1a8cbf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:30.235886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511197b7-33c8-41c8-a76d-d73da1a8cbf8 None admin] RBAC: Adding query filter params (group.id=a7d4397ff5aa4d239492093495d99750, role.id=a284a48d48b2440997815469786a10ec, scope.project.id=309bfab87fbe44008938ccbd283fd590) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:30.236193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511197b7-33c8-41c8-a76d-d73da1a8cbf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:30.237622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511197b7-33c8-41c8-a76d-d73da1a8cbf8 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:30.244044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 209/447] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:30 2022] GET /identity/v3/role_assignments?group.id=a7d4397ff5aa4d239492093495d99750&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=a284a48d48b2440997815469786a10ec => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:30.245030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511197b7-33c8-41c8-a76d-d73da1a8cbf8 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:30.313140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:30.344445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26838aa8-404a-4108-af49-ae8e76272cc4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:30.361947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511197b7-33c8-41c8-a76d-d73da1a8cbf8 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:30.382390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814004e-b11a-4940-a658-48b5d82d5ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:30.383187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814004e-b11a-4940-a658-48b5d82d5ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:30.383499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814004e-b11a-4940-a658-48b5d82d5ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:30.383780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814004e-b11a-4940-a658-48b5d82d5ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:30.384536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814004e-b11a-4940-a658-48b5d82d5ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:30.384835 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814004e-b11a-4940-a658-48b5d82d5ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:30.386231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814004e-b11a-4940-a658-48b5d82d5ff7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:30.395934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 239/448] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:30.400449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc336b3-2114-4118-b9de-24205a5f2f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:30.401291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814004e-b11a-4940-a658-48b5d82d5ff7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:30.401396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc336b3-2114-4118-b9de-24205a5f2f3f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:30.401608 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc336b3-2114-4118-b9de-24205a5f2f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:30.401889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc336b3-2114-4118-b9de-24205a5f2f3f None admin] PATH_INFO: `/v3/projects/309bfab87fbe44008938ccbd283fd590` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:30.403123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc336b3-2114-4118-b9de-24205a5f2f3f None admin] RBAC: Authorizing `identity:get_project(project_id=309bfab87fbe44008938ccbd283fd590)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:30.404638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc336b3-2114-4118-b9de-24205a5f2f3f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:30.411556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 210/449] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:30 2022] GET /identity/v3/projects/309bfab87fbe44008938ccbd283fd590 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:30.413707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc336b3-2114-4118-b9de-24205a5f2f3f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:30.464533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:30.525813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814004e-b11a-4940-a658-48b5d82d5ff7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:30.538828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc336b3-2114-4118-b9de-24205a5f2f3f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:30.562019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef03b-17fb-41f1-b684-f07c3fc97f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:30.563436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef03b-17fb-41f1-b684-f07c3fc97f0e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:30.563436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef03b-17fb-41f1-b684-f07c3fc97f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:30.563436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef03b-17fb-41f1-b684-f07c3fc97f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:30.574038 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:30.581879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae7a0-aaec-4b77-85e0-0dc8bbe9227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:30.582752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae7a0-aaec-4b77-85e0-0dc8bbe9227e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:30.583035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae7a0-aaec-4b77-85e0-0dc8bbe9227e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:30.583311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eae7a0-aaec-4b77-85e0-0dc8bbe9227e None admin] PATH_INFO: `/v3/groups/a7d4397ff5aa4d239492093495d99750` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:30.584543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eae7a0-aaec-4b77-85e0-0dc8bbe9227e None admin] RBAC: Authorizing `identity:get_group(group_id=a7d4397ff5aa4d239492093495d99750)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:30.585968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eae7a0-aaec-4b77-85e0-0dc8bbe9227e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:30.592321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 211/450] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:30 2022] GET /identity/v3/groups/a7d4397ff5aa4d239492093495d99750 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:30.593543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae7a0-aaec-4b77-85e0-0dc8bbe9227e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:30.645657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef03b-17fb-41f1-b684-f07c3fc97f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:30.647118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef03b-17fb-41f1-b684-f07c3fc97f0e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:30.704315 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eae7a0-aaec-4b77-85e0-0dc8bbe9227e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:30.713561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:30.738259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948742ee-6cc1-48a9-950e-88f426b81b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:30.738914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948742ee-6cc1-48a9-950e-88f426b81b9b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:30.739200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948742ee-6cc1-48a9-950e-88f426b81b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:30.739536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948742ee-6cc1-48a9-950e-88f426b81b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:30.740368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948742ee-6cc1-48a9-950e-88f426b81b9b None admin] RBAC: Adding query filter params (group.id=a7d4397ff5aa4d239492093495d99750, role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=309bfab87fbe44008938ccbd283fd590) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:30.740679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948742ee-6cc1-48a9-950e-88f426b81b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:30.742154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948742ee-6cc1-48a9-950e-88f426b81b9b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:30.747957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 212/451] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:30 2022] GET /identity/v3/role_assignments?group.id=a7d4397ff5aa4d239492093495d99750&scope.project.id=309bfab87fbe44008938ccbd283fd590&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:30.748798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 240/452] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:08:30.755248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948742ee-6cc1-48a9-950e-88f426b81b9b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:30.861708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948742ee-6cc1-48a9-950e-88f426b81b9b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:30.897738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b89ef4-e495-4ac4-8ed9-cb95f7c4374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:30.898610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b89ef4-e495-4ac4-8ed9-cb95f7c4374d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:30.898897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b89ef4-e495-4ac4-8ed9-cb95f7c4374d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:30.899178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b89ef4-e495-4ac4-8ed9-cb95f7c4374d None admin] PATH_INFO: `/v3/projects/4a7d532589ce43f88947a3878f92cba0` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:30.900431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b89ef4-e495-4ac4-8ed9-cb95f7c4374d None admin] RBAC: Authorizing `identity:get_project(project_id=4a7d532589ce43f88947a3878f92cba0)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:30.901888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b89ef4-e495-4ac4-8ed9-cb95f7c4374d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:30.903705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 213/453] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:08:30 2022] GET /identity/v3/projects/4a7d532589ce43f88947a3878f92cba0 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:30.909306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef03b-17fb-41f1-b684-f07c3fc97f0e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:30.950665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:31.012439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef03b-17fb-41f1-b684-f07c3fc97f0e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:31.046272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28e01f-59d5-48c6-91e4-39f46019fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:31.047135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e01f-59d5-48c6-91e4-39f46019fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:31.047457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e01f-59d5-48c6-91e4-39f46019fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:31.047743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e01f-59d5-48c6-91e4-39f46019fdf2 None admin] PATH_INFO: `/v3/groups/cb2344c6aa194eda8bac1cd0b378e312` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:31.048923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28e01f-59d5-48c6-91e4-39f46019fdf2 None admin] RBAC: Authorizing `identity:get_group(group_id=cb2344c6aa194eda8bac1cd0b378e312)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:31.050905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28e01f-59d5-48c6-91e4-39f46019fdf2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:31.052559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 241/454] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jun 7 14:08:30 2022] GET /identity/v3/groups/cb2344c6aa194eda8bac1cd0b378e312 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:31.058366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b89ef4-e495-4ac4-8ed9-cb95f7c4374d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:31.104937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:31.163224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b89ef4-e495-4ac4-8ed9-cb95f7c4374d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:31.196365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2f708-d8cf-4a65-83ce-a625651e008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:31.197038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2f708-d8cf-4a65-83ce-a625651e008a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:31.197579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2f708-d8cf-4a65-83ce-a625651e008a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:31.197857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2f708-d8cf-4a65-83ce-a625651e008a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:31.198692 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2f708-d8cf-4a65-83ce-a625651e008a None admin] RBAC: Adding query filter params (group.id=cb2344c6aa194eda8bac1cd0b378e312, role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=4a7d532589ce43f88947a3878f92cba0) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:31.199003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2f708-d8cf-4a65-83ce-a625651e008a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:31.200475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2f708-d8cf-4a65-83ce-a625651e008a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:31.206196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 214/455] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jun 7 14:08:31 2022] GET /identity/v3/role_assignments?group.id=cb2344c6aa194eda8bac1cd0b378e312&scope.project.id=4a7d532589ce43f88947a3878f92cba0&role.id=c6577847f998435991dac5744a94d0ee => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:33.999550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52350bb-273e-4362-9480-ea4ff7e9d2a9 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.000092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52350bb-273e-4362-9480-ea4ff7e9d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.000092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52350bb-273e-4362-9480-ea4ff7e9d2a9 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.001727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 242/456] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:34.012785 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd391e8-bb3f-4052-860c-364f1252ea2a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.013244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd391e8-bb3f-4052-860c-364f1252ea2a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.013329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd391e8-bb3f-4052-860c-364f1252ea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.036345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-5fd391e8-bb3f-4052-860c-364f1252ea2a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:34.037570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5fd391e8-bb3f-4052-860c-364f1252ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:34.129073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4540ee1-6b4d-4564-ab97-7f1e40136b33 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.129734 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4540ee1-6b4d-4564-ab97-7f1e40136b33 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.130210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4540ee1-6b4d-4564-ab97-7f1e40136b33 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.132112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 243/457] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:34.137477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d7115-9bf8-4067-83a1-fd57148655ea None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.137864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 215/458] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:34.138324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d7115-9bf8-4067-83a1-fd57148655ea None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.138797 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d7115-9bf8-4067-83a1-fd57148655ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.150769 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c26482-6812-4902-b99e-1d195cf4032f None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.151434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c26482-6812-4902-b99e-1d195cf4032f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.151914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c26482-6812-4902-b99e-1d195cf4032f None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.153770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 216/459] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:34.160663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f506-30a2-4a59-b8f9-7bb1f58138e5 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.161209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f506-30a2-4a59-b8f9-7bb1f58138e5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.161789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3f506-30a2-4a59-b8f9-7bb1f58138e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.168075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-544d7115-9bf8-4067-83a1-fd57148655ea None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:34.169282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-544d7115-9bf8-4067-83a1-fd57148655ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:34.179428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e4c3f506-30a2-4a59-b8f9-7bb1f58138e5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:34.180619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e4c3f506-30a2-4a59-b8f9-7bb1f58138e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:34.208516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:34.247292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 244/460] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:34.248719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d7115-9bf8-4067-83a1-fd57148655ea None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:34.250832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 217/461] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:34.275008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3f506-30a2-4a59-b8f9-7bb1f58138e5 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:34.339748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:34.355925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d7115-9bf8-4067-83a1-fd57148655ea None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:34.380014 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3f506-30a2-4a59-b8f9-7bb1f58138e5 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:34.393840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767843ee-4863-4312-a051-6d7e7398483f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:34.394648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767843ee-4863-4312-a051-6d7e7398483f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.394934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767843ee-4863-4312-a051-6d7e7398483f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.395214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767843ee-4863-4312-a051-6d7e7398483f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.406039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767843ee-4863-4312-a051-6d7e7398483f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:34.407538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767843ee-4863-4312-a051-6d7e7398483f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:34.417262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7a0f-3ca0-432d-9bc2-2127a5062150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:34.418382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7a0f-3ca0-432d-9bc2-2127a5062150 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.418872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7a0f-3ca0-432d-9bc2-2127a5062150 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.419374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7a0f-3ca0-432d-9bc2-2127a5062150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.431724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d7a0f-3ca0-432d-9bc2-2127a5062150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:34.433650 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d7a0f-3ca0-432d-9bc2-2127a5062150 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-822d7a0f-3ca0-432d-9bc2-2127a5062150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:34.455714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:34.457178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:34.458048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:34.458048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:34.458048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:34.458048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:34.460623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 218/462] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:34.461933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7a0f-3ca0-432d-9bc2-2127a5062150 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:34.483859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-767843ee-4863-4312-a051-6d7e7398483f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:34.554924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:34.555883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:34.556719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:34.556719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:34.556719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:34.556719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:34.562447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 245/463] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:34.562447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767843ee-4863-4312-a051-6d7e7398483f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:34.591532 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7a0f-3ca0-432d-9bc2-2127a5062150 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:34.636321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530ba82-caa9-43f2-a9de-18818ce15717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:34.637483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530ba82-caa9-43f2-a9de-18818ce15717 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.637951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530ba82-caa9-43f2-a9de-18818ce15717 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.638408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530ba82-caa9-43f2-a9de-18818ce15717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.649983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530ba82-caa9-43f2-a9de-18818ce15717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:34.651718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530ba82-caa9-43f2-a9de-18818ce15717 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:34.658154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-b530ba82-caa9-43f2-a9de-18818ce15717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:34.670803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:34.671686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:34.672540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:34.672540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:34.672540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:34.672540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:34.672745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767843ee-4863-4312-a051-6d7e7398483f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:34.675020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 219/464] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:34.676065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530ba82-caa9-43f2-a9de-18818ce15717 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:34.709164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfb00d-865d-43ff-8ac1-5e9baf4279a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:34.709834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfb00d-865d-43ff-8ac1-5e9baf4279a0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.710121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfb00d-865d-43ff-8ac1-5e9baf4279a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.710400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfb00d-865d-43ff-8ac1-5e9baf4279a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.711140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfb00d-865d-43ff-8ac1-5e9baf4279a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:34.711493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfb00d-865d-43ff-8ac1-5e9baf4279a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:34.712863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfb00d-865d-43ff-8ac1-5e9baf4279a0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:34.725433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 246/465] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:34.726388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfb00d-865d-43ff-8ac1-5e9baf4279a0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:34.750364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:34.787304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530ba82-caa9-43f2-a9de-18818ce15717 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:34.824997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46878c4d-8299-4900-9a98-31ec2a1652f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:34.825688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46878c4d-8299-4900-9a98-31ec2a1652f1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.825976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46878c4d-8299-4900-9a98-31ec2a1652f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.826265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46878c4d-8299-4900-9a98-31ec2a1652f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.827003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46878c4d-8299-4900-9a98-31ec2a1652f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:34.827309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46878c4d-8299-4900-9a98-31ec2a1652f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:34.828732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46878c4d-8299-4900-9a98-31ec2a1652f1 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:34.833057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfb00d-865d-43ff-8ac1-5e9baf4279a0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:34.845803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 220/466] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:34.845803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46878c4d-8299-4900-9a98-31ec2a1652f1 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:34.869123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d16d5f-15b2-4c45-be15-6e997e82173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:34.869796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d16d5f-15b2-4c45-be15-6e997e82173d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.870082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d16d5f-15b2-4c45-be15-6e997e82173d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.870362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d16d5f-15b2-4c45-be15-6e997e82173d None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.871094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d16d5f-15b2-4c45-be15-6e997e82173d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:34.871432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d16d5f-15b2-4c45-be15-6e997e82173d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:34.872790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d16d5f-15b2-4c45-be15-6e997e82173d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:34.886355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 247/467] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:34.887663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd81784-1829-4e54-ae31-93639f3cd099 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.887952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd81784-1829-4e54-ae31-93639f3cd099 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.888228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd81784-1829-4e54-ae31-93639f3cd099 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.889600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 248/468] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:34.890133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd81784-1829-4e54-ae31-93639f3cd099 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:34.902721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:34.958067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46878c4d-8299-4900-9a98-31ec2a1652f1 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:34.988430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:34.997439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666461f4-02b5-4a1b-acaa-9ad8fbb39f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:34.998129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666461f4-02b5-4a1b-acaa-9ad8fbb39f6c None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:34.998417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666461f4-02b5-4a1b-acaa-9ad8fbb39f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:34.998697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666461f4-02b5-4a1b-acaa-9ad8fbb39f6c None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:34.999472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666461f4-02b5-4a1b-acaa-9ad8fbb39f6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:35.000968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666461f4-02b5-4a1b-acaa-9ad8fbb39f6c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:35.004790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd81784-1829-4e54-ae31-93639f3cd099 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:35.022525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 221/469] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:08:34 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:08:35.024003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666461f4-02b5-4a1b-acaa-9ad8fbb39f6c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:35.060493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386bd7b-5739-4e6f-beaa-22d88c67e876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:35.061722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386bd7b-5739-4e6f-beaa-22d88c67e876 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.062011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386bd7b-5739-4e6f-beaa-22d88c67e876 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.062327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386bd7b-5739-4e6f-beaa-22d88c67e876 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.063566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386bd7b-5739-4e6f-beaa-22d88c67e876 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:35.065428 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386bd7b-5739-4e6f-beaa-22d88c67e876 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:35.093498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 249/470] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:08:34 2022] POST /identity/v3/users => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:08:35.095233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c5dca-27c6-4d33-b130-240455add5c8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.095700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c5dca-27c6-4d33-b130-240455add5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.096108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c5dca-27c6-4d33-b130-240455add5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.118576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fc9c5dca-27c6-4d33-b130-240455add5c8 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:35.120070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fc9c5dca-27c6-4d33-b130-240455add5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:35.194151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666461f4-02b5-4a1b-acaa-9ad8fbb39f6c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:35.209826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 250/471] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:35.215097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:35.241345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c5dca-27c6-4d33-b130-240455add5c8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:35.262181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60673285-b056-481b-b407-d42b2bac34b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:35.262992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60673285-b056-481b-b407-d42b2bac34b5 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.263478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60673285-b056-481b-b407-d42b2bac34b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.263904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60673285-b056-481b-b407-d42b2bac34b5 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.264780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60673285-b056-481b-b407-d42b2bac34b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:35.266537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60673285-b056-481b-b407-d42b2bac34b5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:35.295296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 222/472] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:08:35 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:08:35.331079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6967-6a0c-4072-95e3-dfa6eeb1c1a6 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.331895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6967-6a0c-4072-95e3-dfa6eeb1c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.332448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a6967-6a0c-4072-95e3-dfa6eeb1c1a6 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.335090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 223/473] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:35.342568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6de02-f607-4951-a40d-ac5203959540 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.343281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6de02-f607-4951-a40d-ac5203959540 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.343909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6de02-f607-4951-a40d-ac5203959540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.366282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-9af6de02-f607-4951-a40d-ac5203959540 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:35.367941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9af6de02-f607-4951-a40d-ac5203959540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:35.386519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c5dca-27c6-4d33-b130-240455add5c8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:35.415487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:35.438135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dac3a2-180c-4bf2-b81f-3961414576ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:35.439330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dac3a2-180c-4bf2-b81f-3961414576ee None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.439926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dac3a2-180c-4bf2-b81f-3961414576ee None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.440558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dac3a2-180c-4bf2-b81f-3961414576ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.454155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dac3a2-180c-4bf2-b81f-3961414576ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:35.457018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dac3a2-180c-4bf2-b81f-3961414576ee None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:35.461266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 224/474] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-c0dac3a2-180c-4bf2-b81f-3961414576ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:35.477015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:35.477943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:35.478786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:35.478786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:35.478786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:35.478786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:35.478786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 251/475] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:35.484414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6de02-f607-4951-a40d-ac5203959540 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:35.506600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dac3a2-180c-4bf2-b81f-3961414576ee None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:35.575735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:35.632354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6de02-f607-4951-a40d-ac5203959540 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:35.640835 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dac3a2-180c-4bf2-b81f-3961414576ee None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:35.681784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6d39c-e2c6-44bd-9a18-5548aa1b454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:35.682455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d39c-e2c6-44bd-9a18-5548aa1b454b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.682738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d39c-e2c6-44bd-9a18-5548aa1b454b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.683009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6d39c-e2c6-44bd-9a18-5548aa1b454b None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.683805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6d39c-e2c6-44bd-9a18-5548aa1b454b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:35.684069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6d39c-e2c6-44bd-9a18-5548aa1b454b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:35.685457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6d39c-e2c6-44bd-9a18-5548aa1b454b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:35.686376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:35.687508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.688543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.689032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.690121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:35.691732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:35.697868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 225/476] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:35.703373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6d39c-e2c6-44bd-9a18-5548aa1b454b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:35.706607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.sql.core [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 14:08:35.706607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 07 14:08:35.706607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [parameters: {'id': '4da47371298a4de98c85fb3ffb5879c3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 07 14:08:35.706607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80293) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application result.read() Jun 07 14:08:35.739069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return ref.to_dict() Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:08:35.740021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application yield resource Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise self.value Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application session.commit() Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 14:08:35.740980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.session.flush() Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application compat.raise_( Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 14:08:35.741856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:08:35.742765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application result.read() Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:08:35.745665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [parameters: {'id': '4da47371298a4de98c85fb3ffb5879c3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:35.748097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 07 14:08:35.750621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:35.753927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 252/477] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jun 7 14:08:35 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:35.753927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:35.761697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:35.882585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6d39c-e2c6-44bd-9a18-5548aa1b454b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:35.917516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3d9f0-da91-415a-a2fc-92556fbdee05 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:35.929200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:35.958430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff903f0-9179-4d49-98bd-7d0b8fc76f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:35.959251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff903f0-9179-4d49-98bd-7d0b8fc76f87 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.960092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff903f0-9179-4d49-98bd-7d0b8fc76f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.960374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff903f0-9179-4d49-98bd-7d0b8fc76f87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.961457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd875e9-d9b8-4e21-a3a7-4be443f3ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:35.962131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd875e9-d9b8-4e21-a3a7-4be443f3ec59 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:35.962418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd875e9-d9b8-4e21-a3a7-4be443f3ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:35.962786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd875e9-d9b8-4e21-a3a7-4be443f3ec59 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:35.963546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd875e9-d9b8-4e21-a3a7-4be443f3ec59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:35.965003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd875e9-d9b8-4e21-a3a7-4be443f3ec59 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:35.986789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff903f0-9179-4d49-98bd-7d0b8fc76f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-1ff903f0-9179-4d49-98bd-7d0b8fc76f87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:35.996605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:35.997497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:35.998314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 253/478] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:08:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:36.003458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff903f0-9179-4d49-98bd-7d0b8fc76f87 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:36.007995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 226/479] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:08:35 2022] POST /identity/v3/users => generated 249 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:08:36.122675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff903f0-9179-4d49-98bd-7d0b8fc76f87 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:36.162202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f6a9b-150f-4334-a618-7acf51263268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:36.162797 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f6a9b-150f-4334-a618-7acf51263268 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:36.163079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f6a9b-150f-4334-a618-7acf51263268 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:36.163377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f6a9b-150f-4334-a618-7acf51263268 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:36.164142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f6a9b-150f-4334-a618-7acf51263268 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:36.164448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f6a9b-150f-4334-a618-7acf51263268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:36.165819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f6a9b-150f-4334-a618-7acf51263268 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:36.175680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 254/480] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:37.935536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a73e1-0ee7-4dc2-9e58-cc512807c2b2 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:37.935536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a73e1-0ee7-4dc2-9e58-cc512807c2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:37.935536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a73e1-0ee7-4dc2-9e58-cc512807c2b2 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:37.936882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 227/481] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:37.942664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808751ee-a232-4123-8f0b-47106c840752 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:37.943143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808751ee-a232-4123-8f0b-47106c840752 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:37.943329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808751ee-a232-4123-8f0b-47106c840752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:37.964310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-808751ee-a232-4123-8f0b-47106c840752 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:37.965501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-808751ee-a232-4123-8f0b-47106c840752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:38.001620 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:38.057623 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 255/482] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:38.090615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a73e1-0ee7-4dc2-9e58-cc512807c2b2 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:38.179624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f94ab4-f5e6-4887-8583-59b7d66bea4e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.180254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f94ab4-f5e6-4887-8583-59b7d66bea4e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.180753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f94ab4-f5e6-4887-8583-59b7d66bea4e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.182955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 256/483] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:38.187478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c4a46-dde6-4f8e-b89e-48d2e3df5f82 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.188348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c4a46-dde6-4f8e-b89e-48d2e3df5f82 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.188831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c4a46-dde6-4f8e-b89e-48d2e3df5f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.204137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:38.211461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f62c4a46-dde6-4f8e-b89e-48d2e3df5f82 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:38.212986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f62c4a46-dde6-4f8e-b89e-48d2e3df5f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:38.231620 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a73e1-0ee7-4dc2-9e58-cc512807c2b2 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:38.301460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde72ac-f017-4fe8-80f2-e7704cc06e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:38.302269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde72ac-f017-4fe8-80f2-e7704cc06e7f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.302554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde72ac-f017-4fe8-80f2-e7704cc06e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.302831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde72ac-f017-4fe8-80f2-e7704cc06e7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.319767 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde72ac-f017-4fe8-80f2-e7704cc06e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:38.324097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 257/484] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:38.325610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d377-6995-4138-bc55-cac78c33d67b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.326120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d377-6995-4138-bc55-cac78c33d67b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.326590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d377-6995-4138-bc55-cac78c33d67b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.328343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 258/485] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:38.334356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c9b7c-6893-489c-9019-bf9f09314229 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.334789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c9b7c-6893-489c-9019-bf9f09314229 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.335223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c9b7c-6893-489c-9019-bf9f09314229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-ebde72ac-f017-4fe8-80f2-e7704cc06e7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:38.337072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:38.338150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:38.339045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 228/486] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:38.346983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde72ac-f017-4fe8-80f2-e7704cc06e7f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:38.362484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f64c9b7c-6893-489c-9019-bf9f09314229 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:38.364791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f64c9b7c-6893-489c-9019-bf9f09314229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:38.462371 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 259/487] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:38.464080 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c9b7c-6893-489c-9019-bf9f09314229 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:38.469548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde72ac-f017-4fe8-80f2-e7704cc06e7f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:38.493958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:38.515979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f626-381d-42dd-b694-d7f6eb409a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:38.516923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f626-381d-42dd-b694-d7f6eb409a53 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.517354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f626-381d-42dd-b694-d7f6eb409a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.517773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f626-381d-42dd-b694-d7f6eb409a53 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.518714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f626-381d-42dd-b694-d7f6eb409a53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:38.519169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f626-381d-42dd-b694-d7f6eb409a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:38.520826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f626-381d-42dd-b694-d7f6eb409a53 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:38.529956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 229/488] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:38.530965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f626-381d-42dd-b694-d7f6eb409a53 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:38.544651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:38.602511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c9b7c-6893-489c-9019-bf9f09314229 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:38.650209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf2e88-6596-41df-ad29-ddbcc404387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:38.651003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf2e88-6596-41df-ad29-ddbcc404387d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.651226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f626-381d-42dd-b694-d7f6eb409a53 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:38.651362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf2e88-6596-41df-ad29-ddbcc404387d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.651571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf2e88-6596-41df-ad29-ddbcc404387d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.666740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf2e88-6596-41df-ad29-ddbcc404387d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-98bf2e88-6596-41df-ad29-ddbcc404387d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:38.678577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:38.679782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:38.680597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:38.683432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 260/489] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:38.684935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf2e88-6596-41df-ad29-ddbcc404387d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:38.705920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69789161-6a27-41da-8e12-613c95a8bd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:38.708735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789161-6a27-41da-8e12-613c95a8bd6d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.709095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789161-6a27-41da-8e12-613c95a8bd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.709444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789161-6a27-41da-8e12-613c95a8bd6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.723915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69789161-6a27-41da-8e12-613c95a8bd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-69789161-6a27-41da-8e12-613c95a8bd6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:38.733790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:38.734689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:38.735540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 230/490] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:38.736231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69789161-6a27-41da-8e12-613c95a8bd6d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:38.780967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:38.802423 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf2e88-6596-41df-ad29-ddbcc404387d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:38.830198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:38.853067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d25f-7b44-4923-a3d0-12d59f996bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:38.854289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d25f-7b44-4923-a3d0-12d59f996bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.854743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d25f-7b44-4923-a3d0-12d59f996bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.855184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d25f-7b44-4923-a3d0-12d59f996bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.867669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d25f-7b44-4923-a3d0-12d59f996bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:38.869612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d25f-7b44-4923-a3d0-12d59f996bf3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:38.872822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69789161-6a27-41da-8e12-613c95a8bd6d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-fb73d25f-7b44-4923-a3d0-12d59f996bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:38.888439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:38.889317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:38.890149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:38.890149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:38.890149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:38.890149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:38.892299 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 261/491] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:38.893267 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d25f-7b44-4923-a3d0-12d59f996bf3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:38.920424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbffd87-ccb1-4f31-a101-82549c3df1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:38.921270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbffd87-ccb1-4f31-a101-82549c3df1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:38.921664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbffd87-ccb1-4f31-a101-82549c3df1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:38.922009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbffd87-ccb1-4f31-a101-82549c3df1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:38.922843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbffd87-ccb1-4f31-a101-82549c3df1a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:38.923232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbffd87-ccb1-4f31-a101-82549c3df1a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:38.925353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbffd87-ccb1-4f31-a101-82549c3df1a4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:38.933597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 231/492] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:38.934397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbffd87-ccb1-4f31-a101-82549c3df1a4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.003405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d25f-7b44-4923-a3d0-12d59f996bf3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.037429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd19b00-d6df-43ba-8160-ef0fdb1c64b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.038099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd19b00-d6df-43ba-8160-ef0fdb1c64b2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.038385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd19b00-d6df-43ba-8160-ef0fdb1c64b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.038662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd19b00-d6df-43ba-8160-ef0fdb1c64b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.039439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd19b00-d6df-43ba-8160-ef0fdb1c64b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:39.039749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd19b00-d6df-43ba-8160-ef0fdb1c64b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.041110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd19b00-d6df-43ba-8160-ef0fdb1c64b2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.042439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:39.046135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbffd87-ccb1-4f31-a101-82549c3df1a4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.051499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 262/493] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:39.053011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0377c6-2d9b-4e09-a66f-2871dd6caf83 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.053302 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0377c6-2d9b-4e09-a66f-2871dd6caf83 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.053586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0377c6-2d9b-4e09-a66f-2871dd6caf83 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.054848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 263/494] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:39.055643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0377c6-2d9b-4e09-a66f-2871dd6caf83 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.078550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:39.084665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e6fc-a346-435e-9819-4179a83b3bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.085330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e6fc-a346-435e-9819-4179a83b3bdd None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.085613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e6fc-a346-435e-9819-4179a83b3bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.085893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e6fc-a346-435e-9819-4179a83b3bdd None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.086624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e6fc-a346-435e-9819-4179a83b3bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:39.086932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e6fc-a346-435e-9819-4179a83b3bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.088338 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9e6fc-a346-435e-9819-4179a83b3bdd None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.100597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 232/495] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:39.101885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae250db5-5fbb-44e1-9e84-95d0f11753dc None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.102179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae250db5-5fbb-44e1-9e84-95d0f11753dc None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.102478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae250db5-5fbb-44e1-9e84-95d0f11753dc None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.104003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 233/496] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:39.104964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae250db5-5fbb-44e1-9e84-95d0f11753dc None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.159589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0377c6-2d9b-4e09-a66f-2871dd6caf83 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.192366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6db021-d938-4fd1-a3ee-1452eebd5e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.193158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6db021-d938-4fd1-a3ee-1452eebd5e9b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.193444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6db021-d938-4fd1-a3ee-1452eebd5e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.193722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6db021-d938-4fd1-a3ee-1452eebd5e9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.203653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6db021-d938-4fd1-a3ee-1452eebd5e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.205078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6db021-d938-4fd1-a3ee-1452eebd5e9b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.210827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae250db5-5fbb-44e1-9e84-95d0f11753dc None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-fd6db021-d938-4fd1-a3ee-1452eebd5e9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:39.223760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:39.224761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:39.230227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:39.230227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:39.230227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:39.230227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:39.230227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 264/497] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:39.230227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baad04-bf1a-4aab-b9d7-76a6da3104d9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.230227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baad04-bf1a-4aab-b9d7-76a6da3104d9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.230227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baad04-bf1a-4aab-b9d7-76a6da3104d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.242514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d3baad04-bf1a-4aab-b9d7-76a6da3104d9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:39.243718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d3baad04-bf1a-4aab-b9d7-76a6da3104d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:39.244665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9faf8-0fe9-4b27-96b3-db8b95468025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.245460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9faf8-0fe9-4b27-96b3-db8b95468025 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.245745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9faf8-0fe9-4b27-96b3-db8b95468025 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.246023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9faf8-0fe9-4b27-96b3-db8b95468025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.256035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9faf8-0fe9-4b27-96b3-db8b95468025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.257411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9faf8-0fe9-4b27-96b3-db8b95468025 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-78d9faf8-0fe9-4b27-96b3-db8b95468025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:39.275055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:39.276119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:39.277162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:39.277162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:39.277162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:39.277162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:39.277162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 234/498] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:39.277162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9faf8-0fe9-4b27-96b3-db8b95468025 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.290973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:39.313749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 265/499] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:39.315092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb68e1-6b78-437c-b878-5bb744713da5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.315417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb68e1-6b78-437c-b878-5bb744713da5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.315700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb68e1-6b78-437c-b878-5bb744713da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.325117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:39.332091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f5bb68e1-6b78-437c-b878-5bb744713da5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:39.333269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f5bb68e1-6b78-437c-b878-5bb744713da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:39.382015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9faf8-0fe9-4b27-96b3-db8b95468025 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.398723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 266/500] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:39.399576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb68e1-6b78-437c-b878-5bb744713da5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.424810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07f3d7-74c5-41fe-9069-20e21604f892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.425639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07f3d7-74c5-41fe-9069-20e21604f892 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.425927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07f3d7-74c5-41fe-9069-20e21604f892 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.426203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07f3d7-74c5-41fe-9069-20e21604f892 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.433259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07f3d7-74c5-41fe-9069-20e21604f892 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.434690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07f3d7-74c5-41fe-9069-20e21604f892 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-cd07f3d7-74c5-41fe-9069-20e21604f892 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:39.450481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:39.451603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 235/501] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:39.457728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07f3d7-74c5-41fe-9069-20e21604f892 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.499400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb68e1-6b78-437c-b878-5bb744713da5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.508498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:39.534186 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb088b-5008-43ba-a034-1a729691d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.534841 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb088b-5008-43ba-a034-1a729691d34f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.535117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb088b-5008-43ba-a034-1a729691d34f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.535412 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb088b-5008-43ba-a034-1a729691d34f None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.536132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb088b-5008-43ba-a034-1a729691d34f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:39.536432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb088b-5008-43ba-a034-1a729691d34f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.537777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb088b-5008-43ba-a034-1a729691d34f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.548588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 267/502] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:39.549391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb088b-5008-43ba-a034-1a729691d34f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.556710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07f3d7-74c5-41fe-9069-20e21604f892 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.558231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:39.593256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f2194-c10a-41a3-9f3b-58c80452a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.593918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f2194-c10a-41a3-9f3b-58c80452a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.594199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f2194-c10a-41a3-9f3b-58c80452a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.594474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f2194-c10a-41a3-9f3b-58c80452a3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.595207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f2194-c10a-41a3-9f3b-58c80452a3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:39.595539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f2194-c10a-41a3-9f3b-58c80452a3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.596947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f2194-c10a-41a3-9f3b-58c80452a3c5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.608273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 236/503] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:39.609047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f2194-c10a-41a3-9f3b-58c80452a3c5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.651691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb088b-5008-43ba-a034-1a729691d34f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.686271 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88e1a4-1f34-4886-aba9-0930425f7c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.687071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88e1a4-1f34-4886-aba9-0930425f7c5c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.687374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88e1a4-1f34-4886-aba9-0930425f7c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.687658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88e1a4-1f34-4886-aba9-0930425f7c5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.698464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88e1a4-1f34-4886-aba9-0930425f7c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8b88e1a4-1f34-4886-aba9-0930425f7c5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:39.706929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:39.708004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:39.708986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:39.709724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f2194-c10a-41a3-9f3b-58c80452a3c5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.711482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 268/504] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:39.712466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88e1a4-1f34-4886-aba9-0930425f7c5c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.741457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f20e7d-6119-4929-889f-ec17a5e8f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.741659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:39.742337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f20e7d-6119-4929-889f-ec17a5e8f426 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.742617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f20e7d-6119-4929-889f-ec17a5e8f426 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.742931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f20e7d-6119-4929-889f-ec17a5e8f426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.754126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f20e7d-6119-4929-889f-ec17a5e8f426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.755635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f20e7d-6119-4929-889f-ec17a5e8f426 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-50f20e7d-6119-4929-889f-ec17a5e8f426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:39.773862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:39.774864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:39.775951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:39.775951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:39.775951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:39.775951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:39.775951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 237/505] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:39.775951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f20e7d-6119-4929-889f-ec17a5e8f426 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.792470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:39.815363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88e1a4-1f34-4886-aba9-0930425f7c5c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.849085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e71d96-6d07-43ac-9b97-6eb983c1445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.849759 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e71d96-6d07-43ac-9b97-6eb983c1445c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.850048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e71d96-6d07-43ac-9b97-6eb983c1445c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.850331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e71d96-6d07-43ac-9b97-6eb983c1445c None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.851170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e71d96-6d07-43ac-9b97-6eb983c1445c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:39.851529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e71d96-6d07-43ac-9b97-6eb983c1445c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.852954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e71d96-6d07-43ac-9b97-6eb983c1445c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.875988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f20e7d-6119-4929-889f-ec17a5e8f426 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:39.889913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 269/506] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:39.890546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e71d96-6d07-43ac-9b97-6eb983c1445c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.910274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a00a9-be98-435f-84a8-87161776720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:39.911067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a00a9-be98-435f-84a8-87161776720e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:39.911378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a00a9-be98-435f-84a8-87161776720e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:39.911662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a00a9-be98-435f-84a8-87161776720e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:39.919052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a00a9-be98-435f-84a8-87161776720e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:39.920599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a00a9-be98-435f-84a8-87161776720e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-8d8a00a9-be98-435f-84a8-87161776720e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:39.935137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:39.936082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:39.936975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 238/507] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:39.937528 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a00a9-be98-435f-84a8-87161776720e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:39.978195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:39.993612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e71d96-6d07-43ac-9b97-6eb983c1445c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.015667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:40.027449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a73c9-22b9-47e0-a706-c66da4048238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.028188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a73c9-22b9-47e0-a706-c66da4048238 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.028472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a73c9-22b9-47e0-a706-c66da4048238 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.028749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a73c9-22b9-47e0-a706-c66da4048238 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.036750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a73c9-22b9-47e0-a706-c66da4048238 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.038177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a73c9-22b9-47e0-a706-c66da4048238 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.040692 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a00a9-be98-435f-84a8-87161776720e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ff8a73c9-22b9-47e0-a706-c66da4048238 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:40.053984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:40.054861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 270/508] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:40.056398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a73c9-22b9-47e0-a706-c66da4048238 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:40.079433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95033e-56c0-4f15-8f2d-0d3be7abec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.080107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95033e-56c0-4f15-8f2d-0d3be7abec66 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.080421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95033e-56c0-4f15-8f2d-0d3be7abec66 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.080703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95033e-56c0-4f15-8f2d-0d3be7abec66 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.081459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95033e-56c0-4f15-8f2d-0d3be7abec66 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:40.081770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95033e-56c0-4f15-8f2d-0d3be7abec66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.083146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95033e-56c0-4f15-8f2d-0d3be7abec66 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.090902 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 239/509] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:40.091709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95033e-56c0-4f15-8f2d-0d3be7abec66 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:40.156645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a73c9-22b9-47e0-a706-c66da4048238 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.189501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ac12e-6103-4c67-af12-7a5c986c64d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.190748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac12e-6103-4c67-af12-7a5c986c64d5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.191028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac12e-6103-4c67-af12-7a5c986c64d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.191298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac12e-6103-4c67-af12-7a5c986c64d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.192043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ac12e-6103-4c67-af12-7a5c986c64d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:40.192343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ac12e-6103-4c67-af12-7a5c986c64d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.192430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95033e-56c0-4f15-8f2d-0d3be7abec66 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.193702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ac12e-6103-4c67-af12-7a5c986c64d5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.205330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 271/510] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:40.206131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ac12e-6103-4c67-af12-7a5c986c64d5 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:40.214188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:40.225844 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb3ed4-83d6-4224-aba9-3eda07a2be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.226492 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb3ed4-83d6-4224-aba9-3eda07a2be0a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.226778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb3ed4-83d6-4224-aba9-3eda07a2be0a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.227056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb3ed4-83d6-4224-aba9-3eda07a2be0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.231286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:40.296812 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb3ed4-83d6-4224-aba9-3eda07a2be0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.298255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb3ed4-83d6-4224-aba9-3eda07a2be0a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.303506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ac12e-6103-4c67-af12-7a5c986c64d5 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.336573 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796047f4-dae0-440c-b454-6658a2e2fc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.337342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796047f4-dae0-440c-b454-6658a2e2fc14 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.337624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796047f4-dae0-440c-b454-6658a2e2fc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.337900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796047f4-dae0-440c-b454-6658a2e2fc14 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.338717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796047f4-dae0-440c-b454-6658a2e2fc14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:40.339025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796047f4-dae0-440c-b454-6658a2e2fc14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.340529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796047f4-dae0-440c-b454-6658a2e2fc14 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.357376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 272/511] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jun 7 14:08:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:40.358152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796047f4-dae0-440c-b454-6658a2e2fc14 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:40.394679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 240/512] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:40.395534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb3ed4-83d6-4224-aba9-3eda07a2be0a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:40.419314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:40.430797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:40.458539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796047f4-dae0-440c-b454-6658a2e2fc14 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.492737 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ad2e-67ff-4c6d-8349-76eba816ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.493403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ad2e-67ff-4c6d-8349-76eba816ac10 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.493687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ad2e-67ff-4c6d-8349-76eba816ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.494372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ad2e-67ff-4c6d-8349-76eba816ac10 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.494780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ad2e-67ff-4c6d-8349-76eba816ac10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:40.495085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ad2e-67ff-4c6d-8349-76eba816ac10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.496558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ad2e-67ff-4c6d-8349-76eba816ac10 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.498023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb3ed4-83d6-4224-aba9-3eda07a2be0a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.513992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 273/513] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jun 7 14:08:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:40.514766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ad2e-67ff-4c6d-8349-76eba816ac10 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:40.531118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec43e6-e310-4f1f-bff1-a27a08cf27a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.531934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec43e6-e310-4f1f-bff1-a27a08cf27a4 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.532214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec43e6-e310-4f1f-bff1-a27a08cf27a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.532486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec43e6-e310-4f1f-bff1-a27a08cf27a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.542818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec43e6-e310-4f1f-bff1-a27a08cf27a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.544286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec43e6-e310-4f1f-bff1-a27a08cf27a4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e4ec43e6-e310-4f1f-bff1-a27a08cf27a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:40.561942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:40.562907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:40.564342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:40.564342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:40.564342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:40.564342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:40.564342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 241/514] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:40.564342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec43e6-e310-4f1f-bff1-a27a08cf27a4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:40.616326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ad2e-67ff-4c6d-8349-76eba816ac10 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.638064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:40.650621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb5537-872f-44f7-8755-44b2642f5ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.650770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:40.651567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb5537-872f-44f7-8755-44b2642f5ba2 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.651977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb5537-872f-44f7-8755-44b2642f5ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.652323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb5537-872f-44f7-8755-44b2642f5ba2 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.653061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb5537-872f-44f7-8755-44b2642f5ba2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.654493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb5537-872f-44f7-8755-44b2642f5ba2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.663587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec43e6-e310-4f1f-bff1-a27a08cf27a4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.674029 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 274/515] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:08:40 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:08:40.674841 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb5537-872f-44f7-8755-44b2642f5ba2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:40.714680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca8591-6e4f-4d27-8353-b328a6a17403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.715373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca8591-6e4f-4d27-8353-b328a6a17403 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.715667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca8591-6e4f-4d27-8353-b328a6a17403 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.715946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca8591-6e4f-4d27-8353-b328a6a17403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.793607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb5537-872f-44f7-8755-44b2642f5ba2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:40.794876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca8591-6e4f-4d27-8353-b328a6a17403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.796942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca8591-6e4f-4d27-8353-b328a6a17403 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.829636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be22dd4-8494-442d-85d0-818a89cf612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:40.830995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be22dd4-8494-442d-85d0-818a89cf612c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:40.831367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be22dd4-8494-442d-85d0-818a89cf612c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:40.831647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be22dd4-8494-442d-85d0-818a89cf612c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:40.846678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be22dd4-8494-442d-85d0-818a89cf612c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:40.848242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be22dd4-8494-442d-85d0-818a89cf612c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8be22dd4-8494-442d-85d0-818a89cf612c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:40.867022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:40.868116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:40.869127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:40.869127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:40.869127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:40.869127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:40.870684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 275/516] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:40.871715 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be22dd4-8494-442d-85d0-818a89cf612c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:40.914143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:40.995212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be22dd4-8494-442d-85d0-818a89cf612c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.023790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:41.031570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90013aba-a451-4f83-9a7a-4820ba730e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.032691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90013aba-a451-4f83-9a7a-4820ba730e18 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.033107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90013aba-a451-4f83-9a7a-4820ba730e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.033914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90013aba-a451-4f83-9a7a-4820ba730e18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.038848 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 242/517] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:41.039512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca8591-6e4f-4d27-8353-b328a6a17403 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.110684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90013aba-a451-4f83-9a7a-4820ba730e18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.112714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90013aba-a451-4f83-9a7a-4820ba730e18 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.144340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:41.147657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca8591-6e4f-4d27-8353-b328a6a17403 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.184760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87da39-9db6-4366-a1f0-a4bc22d75aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.185429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87da39-9db6-4366-a1f0-a4bc22d75aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.185717 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87da39-9db6-4366-a1f0-a4bc22d75aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.185996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87da39-9db6-4366-a1f0-a4bc22d75aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.186793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87da39-9db6-4366-a1f0-a4bc22d75aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:41.187799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87da39-9db6-4366-a1f0-a4bc22d75aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.188525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87da39-9db6-4366-a1f0-a4bc22d75aa1 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.204998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 243/518] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:41.204998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87da39-9db6-4366-a1f0-a4bc22d75aa1 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.229192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 276/519] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:41.229192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90013aba-a451-4f83-9a7a-4820ba730e18 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.258430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:41.316601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87da39-9db6-4366-a1f0-a4bc22d75aa1 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.330142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90013aba-a451-4f83-9a7a-4820ba730e18 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.352257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd276ab0-354c-4abe-bd7c-a0f03660326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.353254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd276ab0-354c-4abe-bd7c-a0f03660326c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.353254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd276ab0-354c-4abe-bd7c-a0f03660326c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.353475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd276ab0-354c-4abe-bd7c-a0f03660326c None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.354195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd276ab0-354c-4abe-bd7c-a0f03660326c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:41.354501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd276ab0-354c-4abe-bd7c-a0f03660326c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.355897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd276ab0-354c-4abe-bd7c-a0f03660326c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.363545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:41.368283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 244/520] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:41.369167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd276ab0-354c-4abe-bd7c-a0f03660326c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.374829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890dfa4-5721-4316-8983-46629d8eb96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.375658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890dfa4-5721-4316-8983-46629d8eb96a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.375946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890dfa4-5721-4316-8983-46629d8eb96a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.376225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890dfa4-5721-4316-8983-46629d8eb96a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.387113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890dfa4-5721-4316-8983-46629d8eb96a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.388604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890dfa4-5721-4316-8983-46629d8eb96a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a890dfa4-5721-4316-8983-46629d8eb96a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:41.407473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:41.409089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:41.410149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:41.410149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:41.410149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:41.410149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:41.410149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 277/521] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:41.410149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890dfa4-5721-4316-8983-46629d8eb96a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.479612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd276ab0-354c-4abe-bd7c-a0f03660326c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.494239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:41.519204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890dfa4-5721-4316-8983-46629d8eb96a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.522924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc870a0-ff7a-4aed-b79b-ee078eae2f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.524020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc870a0-ff7a-4aed-b79b-ee078eae2f17 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.524449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc870a0-ff7a-4aed-b79b-ee078eae2f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.524867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc870a0-ff7a-4aed-b79b-ee078eae2f17 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.533392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc870a0-ff7a-4aed-b79b-ee078eae2f17 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.535541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc870a0-ff7a-4aed-b79b-ee078eae2f17 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-9fc870a0-ff7a-4aed-b79b-ee078eae2f17 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:41.551082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:41.552134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:08:41.553358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:41.553991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223113b-cc13-4730-be0a-efae31f7b714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.553991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223113b-cc13-4730-be0a-efae31f7b714 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.553991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223113b-cc13-4730-be0a-efae31f7b714 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.554227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223113b-cc13-4730-be0a-efae31f7b714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.555583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 245/522] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:41.556688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc870a0-ff7a-4aed-b79b-ee078eae2f17 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.569897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223113b-cc13-4730-be0a-efae31f7b714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.571328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223113b-cc13-4730-be0a-efae31f7b714 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e223113b-cc13-4730-be0a-efae31f7b714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:41.590104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:41.590976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:41.591904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:41.591904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:41.591904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:41.591904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:41.595799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 278/523] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:41.597055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223113b-cc13-4730-be0a-efae31f7b714 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.629970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:41.662038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc870a0-ff7a-4aed-b79b-ee078eae2f17 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.702831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907f768-f014-4500-b36d-bd83db9dbdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.703696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907f768-f014-4500-b36d-bd83db9dbdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.703986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907f768-f014-4500-b36d-bd83db9dbdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.704267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907f768-f014-4500-b36d-bd83db9dbdd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.707650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223113b-cc13-4730-be0a-efae31f7b714 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.712062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907f768-f014-4500-b36d-bd83db9dbdd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.713510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907f768-f014-4500-b36d-bd83db9dbdd0 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-6907f768-f014-4500-b36d-bd83db9dbdd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:41.729644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:41.730724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:41.732078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:41.732078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:41.732078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:41.732078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:41.732078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:41.732078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:41.732078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:41.732078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:41.735562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 246/524] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:41.736425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907f768-f014-4500-b36d-bd83db9dbdd0 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.750085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0eed2-8b99-42cf-b9e9-981e644c01fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.751293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0eed2-8b99-42cf-b9e9-981e644c01fc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.751782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0eed2-8b99-42cf-b9e9-981e644c01fc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.752314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0eed2-8b99-42cf-b9e9-981e644c01fc None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.753896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0eed2-8b99-42cf-b9e9-981e644c01fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:41.754365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0eed2-8b99-42cf-b9e9-981e644c01fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.756856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0eed2-8b99-42cf-b9e9-981e644c01fc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.767087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:41.774839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 279/525] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:41.779236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0eed2-8b99-42cf-b9e9-981e644c01fc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.873315 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907f768-f014-4500-b36d-bd83db9dbdd0 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.906997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:41.914502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0eed2-8b99-42cf-b9e9-981e644c01fc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:41.914940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90345afd-bbe9-441d-8aaa-070f08ab98f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.915722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90345afd-bbe9-441d-8aaa-070f08ab98f6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.916169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90345afd-bbe9-441d-8aaa-070f08ab98f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.916524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90345afd-bbe9-441d-8aaa-070f08ab98f6 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.917534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90345afd-bbe9-441d-8aaa-070f08ab98f6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:41.917901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90345afd-bbe9-441d-8aaa-070f08ab98f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.919412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90345afd-bbe9-441d-8aaa-070f08ab98f6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.949726 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f7b1-dc12-4f39-abd3-e0f107002742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:41.950400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f7b1-dc12-4f39-abd3-e0f107002742 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:41.950686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f7b1-dc12-4f39-abd3-e0f107002742 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:41.950966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f7b1-dc12-4f39-abd3-e0f107002742 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:41.951775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6f7b1-dc12-4f39-abd3-e0f107002742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:41.952088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6f7b1-dc12-4f39-abd3-e0f107002742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:41.953453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6f7b1-dc12-4f39-abd3-e0f107002742 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:41.962535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 247/526] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:41.962535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90345afd-bbe9-441d-8aaa-070f08ab98f6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:41.973887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 280/527] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:41.975501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f7b1-dc12-4f39-abd3-e0f107002742 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:42.056805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:42.074595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90345afd-bbe9-441d-8aaa-070f08ab98f6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:42.096850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f7b1-dc12-4f39-abd3-e0f107002742 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:42.114975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d29729-e3cb-4b48-b743-3bcd1e2a1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:42.115949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d29729-e3cb-4b48-b743-3bcd1e2a1658 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:42.116236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d29729-e3cb-4b48-b743-3bcd1e2a1658 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:42.116511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d29729-e3cb-4b48-b743-3bcd1e2a1658 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:42.117299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d29729-e3cb-4b48-b743-3bcd1e2a1658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:42.117607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d29729-e3cb-4b48-b743-3bcd1e2a1658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:42.119777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d29729-e3cb-4b48-b743-3bcd1e2a1658 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:42.131807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253f1f3-6a09-44a3-9694-66d401a3a30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:42.132605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253f1f3-6a09-44a3-9694-66d401a3a30e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:42.132894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253f1f3-6a09-44a3-9694-66d401a3a30e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:42.133174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253f1f3-6a09-44a3-9694-66d401a3a30e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:42.139817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253f1f3-6a09-44a3-9694-66d401a3a30e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:42.146191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 248/528] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:42.146333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253f1f3-6a09-44a3-9694-66d401a3a30e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:42.146411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d29729-e3cb-4b48-b743-3bcd1e2a1658 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8253f1f3-6a09-44a3-9694-66d401a3a30e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:42.162949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:42.164011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:42.165043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:42.165043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:42.165043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:42.165043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:42.165043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:42.165043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:42.165043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:42.165043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:42.166135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 281/529] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:42.166728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253f1f3-6a09-44a3-9694-66d401a3a30e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:42.184519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:42.259151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d29729-e3cb-4b48-b743-3bcd1e2a1658 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:42.277431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253f1f3-6a09-44a3-9694-66d401a3a30e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:42.295114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47283f8-123f-4cde-9439-be468a873f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:42.295874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47283f8-123f-4cde-9439-be468a873f76 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:42.296223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47283f8-123f-4cde-9439-be468a873f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:42.296565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47283f8-123f-4cde-9439-be468a873f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:42.315439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:42.316134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0455ab-aa11-47dc-9a6c-29116b1a865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:42.317647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0455ab-aa11-47dc-9a6c-29116b1a865e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:42.318090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0455ab-aa11-47dc-9a6c-29116b1a865e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:42.318437 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0455ab-aa11-47dc-9a6c-29116b1a865e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:42.327255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0455ab-aa11-47dc-9a6c-29116b1a865e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:42.329437 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0455ab-aa11-47dc-9a6c-29116b1a865e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8c0455ab-aa11-47dc-9a6c-29116b1a865e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:42.348136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:42.349221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:42.350250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:42.350250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:42.350250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:42.350250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:42.350250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:42.350250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:42.350250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:42.350250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:42.350669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 282/530] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:42.351059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0455ab-aa11-47dc-9a6c-29116b1a865e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:42.379202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47283f8-123f-4cde-9439-be468a873f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:42.380746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47283f8-123f-4cde-9439-be468a873f76 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:42.435784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:42.465250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0455ab-aa11-47dc-9a6c-29116b1a865e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:42.491803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 249/531] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:42.491803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47283f8-123f-4cde-9439-be468a873f76 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:42.507010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2965c2c-9fbe-4604-b536-7af1f564bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:42.507704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2965c2c-9fbe-4604-b536-7af1f564bc96 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:42.507988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2965c2c-9fbe-4604-b536-7af1f564bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:42.508272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2965c2c-9fbe-4604-b536-7af1f564bc96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:42.509110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2965c2c-9fbe-4604-b536-7af1f564bc96 None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=dbba49c3d7c24cd699d85fb93c76e7fe) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:42.509421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2965c2c-9fbe-4604-b536-7af1f564bc96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:42.510836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2965c2c-9fbe-4604-b536-7af1f564bc96 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:42.516881 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 283/532] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:42 2022] GET /identity/v3/role_assignments?user.id=dbba49c3d7c24cd699d85fb93c76e7fe&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:42.528402 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2965c2c-9fbe-4604-b536-7af1f564bc96 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:42.541285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:42.619811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47283f8-123f-4cde-9439-be468a873f76 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:42.662370 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07413a3d-289b-42b2-9ff8-640257fab051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:42.663539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07413a3d-289b-42b2-9ff8-640257fab051 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:42.663539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07413a3d-289b-42b2-9ff8-640257fab051 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:42.663975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07413a3d-289b-42b2-9ff8-640257fab051 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:42.664906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07413a3d-289b-42b2-9ff8-640257fab051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:42.665321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07413a3d-289b-42b2-9ff8-640257fab051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:42.666879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07413a3d-289b-42b2-9ff8-640257fab051 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:42.674528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2965c2c-9fbe-4604-b536-7af1f564bc96 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:42.685484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 250/533] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:42.685484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07413a3d-289b-42b2-9ff8-640257fab051 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:42.721756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f2ac-8fe8-4415-be66-9d8882346936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:42.722664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f2ac-8fe8-4415-be66-9d8882346936 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:42.722946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f2ac-8fe8-4415-be66-9d8882346936 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:42.723219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f2ac-8fe8-4415-be66-9d8882346936 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:42.724070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471f2ac-8fe8-4415-be66-9d8882346936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:42.724382 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471f2ac-8fe8-4415-be66-9d8882346936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:42.725833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471f2ac-8fe8-4415-be66-9d8882346936 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:42.738746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:42.751862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 284/534] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:42.751862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f2ac-8fe8-4415-be66-9d8882346936 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:42.810400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07413a3d-289b-42b2-9ff8-640257fab051 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:42.819988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:42.854990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97928-c1bd-4af9-a49d-a82b8af94702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:42.856382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97928-c1bd-4af9-a49d-a82b8af94702 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:42.856679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97928-c1bd-4af9-a49d-a82b8af94702 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:42.856961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97928-c1bd-4af9-a49d-a82b8af94702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:42.871652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd97928-c1bd-4af9-a49d-a82b8af94702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:42.873547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd97928-c1bd-4af9-a49d-a82b8af94702 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:42.887734 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f2ac-8fe8-4415-be66-9d8882346936 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-5dd97928-c1bd-4af9-a49d-a82b8af94702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:42.896672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:42.897538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:42.898540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:42.898540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:42.898540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:42.898540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:42.903879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 251/535] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:42.903879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97928-c1bd-4af9-a49d-a82b8af94702 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:42.935175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c31f-bb47-41c1-83c7-9a29884c401e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:42.936263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c31f-bb47-41c1-83c7-9a29884c401e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:42.936263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c31f-bb47-41c1-83c7-9a29884c401e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:42.938677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c31f-bb47-41c1-83c7-9a29884c401e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:42.938677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074c31f-bb47-41c1-83c7-9a29884c401e None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=e1ea02cd5e644aaba236acf4e46cb20f) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:42.938677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074c31f-bb47-41c1-83c7-9a29884c401e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:42.939745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074c31f-bb47-41c1-83c7-9a29884c401e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:42.947375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 285/536] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:42 2022] GET /identity/v3/role_assignments?user.id=e1ea02cd5e644aaba236acf4e46cb20f&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:42.947375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c31f-bb47-41c1-83c7-9a29884c401e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:43.021172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:43.031037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97928-c1bd-4af9-a49d-a82b8af94702 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:43.069695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8636b0-b8e8-4ad9-bfd9-96af1352e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:43.070637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8636b0-b8e8-4ad9-bfd9-96af1352e5ac None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.071065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8636b0-b8e8-4ad9-bfd9-96af1352e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.071566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8636b0-b8e8-4ad9-bfd9-96af1352e5ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.072824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8636b0-b8e8-4ad9-bfd9-96af1352e5ac None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=a418c5817e784d299c8d6daad20c6cdb) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:43.073303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8636b0-b8e8-4ad9-bfd9-96af1352e5ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:43.074904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8636b0-b8e8-4ad9-bfd9-96af1352e5ac None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:43.075028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c31f-bb47-41c1-83c7-9a29884c401e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:43.087544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 252/537] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:42 2022] GET /identity/v3/role_assignments?user.id=a418c5817e784d299c8d6daad20c6cdb&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:43.090472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d602-456e-45f6-af31-ce7cb09950c5 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.092911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d602-456e-45f6-af31-ce7cb09950c5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.093439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d602-456e-45f6-af31-ce7cb09950c5 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.095118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 253/538] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:43.107900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b195b-b4db-42a4-8b36-71ff98229c61 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.108435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b195b-b4db-42a4-8b36-71ff98229c61 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.108917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b195b-b4db-42a4-8b36-71ff98229c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.134180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-df7b195b-b4db-42a4-8b36-71ff98229c61 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:43.136719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-df7b195b-b4db-42a4-8b36-71ff98229c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:43.143655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffc677-91be-4d9c-9fd6-a2779647c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:43.144989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffc677-91be-4d9c-9fd6-a2779647c471 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.145535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffc677-91be-4d9c-9fd6-a2779647c471 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.145953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffc677-91be-4d9c-9fd6-a2779647c471 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.146856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffc677-91be-4d9c-9fd6-a2779647c471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:43.147364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffc677-91be-4d9c-9fd6-a2779647c471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:43.149526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ffc677-91be-4d9c-9fd6-a2779647c471 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:43.178762 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:43.181205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 286/539] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:43.187546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffc677-91be-4d9c-9fd6-a2779647c471 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:43.263966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 254/540] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:43.288785 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b195b-b4db-42a4-8b36-71ff98229c61 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:43.377863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffc677-91be-4d9c-9fd6-a2779647c471 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:43.423613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b195b-b4db-42a4-8b36-71ff98229c61 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:43.434126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:43.466083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b9535-f9bb-4c8e-8906-3dee9d436288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:43.466984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b9535-f9bb-4c8e-8906-3dee9d436288 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.467523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b9535-f9bb-4c8e-8906-3dee9d436288 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.468325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b9535-f9bb-4c8e-8906-3dee9d436288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.473493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06054916-f7a9-4576-b813-a8147272018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:43.475029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06054916-f7a9-4576-b813-a8147272018a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.479072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06054916-f7a9-4576-b813-a8147272018a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.479466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06054916-f7a9-4576-b813-a8147272018a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.481253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b9535-f9bb-4c8e-8906-3dee9d436288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:43.484044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b9535-f9bb-4c8e-8906-3dee9d436288 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:43.496436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06054916-f7a9-4576-b813-a8147272018a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-06054916-f7a9-4576-b813-a8147272018a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:43.504958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:43.506057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:43.507077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:43.509439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 255/541] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-1b2b9535-f9bb-4c8e-8906-3dee9d436288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:43.512552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:43.513569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:43.514641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:43.514641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:43.514641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:43.514641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:43.514641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:43.514641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:43.514641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:43.514641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:43.516191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 287/542] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:43.517053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06054916-f7a9-4576-b813-a8147272018a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:43.522166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b9535-f9bb-4c8e-8906-3dee9d436288 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:43.544256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:43.683507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b9535-f9bb-4c8e-8906-3dee9d436288 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:43.693471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06054916-f7a9-4576-b813-a8147272018a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:43.723714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3c594-800e-4adb-a51f-75c16afa8423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:43.724390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c594-800e-4adb-a51f-75c16afa8423 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.724672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c594-800e-4adb-a51f-75c16afa8423 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.724949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c594-800e-4adb-a51f-75c16afa8423 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.725749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3c594-800e-4adb-a51f-75c16afa8423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:43.726062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3c594-800e-4adb-a51f-75c16afa8423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:43.731728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3c594-800e-4adb-a51f-75c16afa8423 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:43.752916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8dfa7-8506-4e5f-a476-59cc7e59c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:43.753611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8dfa7-8506-4e5f-a476-59cc7e59c953 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.753892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8dfa7-8506-4e5f-a476-59cc7e59c953 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.754171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8dfa7-8506-4e5f-a476-59cc7e59c953 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.755053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8dfa7-8506-4e5f-a476-59cc7e59c953 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:43.755386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8dfa7-8506-4e5f-a476-59cc7e59c953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:43.756762 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8dfa7-8506-4e5f-a476-59cc7e59c953 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:43.765663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 256/544] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:43.765847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 288/544] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:43.771897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3c594-800e-4adb-a51f-75c16afa8423 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:43.773081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8dfa7-8506-4e5f-a476-59cc7e59c953 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:43.875569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:43.880085 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:43.915525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8dfa7-8506-4e5f-a476-59cc7e59c953 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:43.938776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3c594-800e-4adb-a51f-75c16afa8423 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:43.950175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a219c3-d022-43bd-89e6-2f29b897c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:43.950834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a219c3-d022-43bd-89e6-2f29b897c96c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.951118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a219c3-d022-43bd-89e6-2f29b897c96c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.951421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a219c3-d022-43bd-89e6-2f29b897c96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.952267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a219c3-d022-43bd-89e6-2f29b897c96c None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=fafd295a115c4f5d912e49d6a21d67b3) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:43.952576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a219c3-d022-43bd-89e6-2f29b897c96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:43.954145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a219c3-d022-43bd-89e6-2f29b897c96c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:43.960993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 257/545] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:43 2022] GET /identity/v3/role_assignments?user.id=fafd295a115c4f5d912e49d6a21d67b3&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:43.978092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60da095-5673-4022-ae4b-bd2054c32eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:43.978889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60da095-5673-4022-ae4b-bd2054c32eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:43.979167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60da095-5673-4022-ae4b-bd2054c32eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:43.979464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60da095-5673-4022-ae4b-bd2054c32eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:43.990484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60da095-5673-4022-ae4b-bd2054c32eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:43.991995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60da095-5673-4022-ae4b-bd2054c32eb6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f60da095-5673-4022-ae4b-bd2054c32eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:44.012044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:44.013818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:44.014906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:44.014906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:44.014906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:44.014906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:44.014906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 289/546] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:44.021673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a219c3-d022-43bd-89e6-2f29b897c96c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:44.180233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a219c3-d022-43bd-89e6-2f29b897c96c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:44.232920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a79a4-bcc2-42e9-9728-3c7c49b6bee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:44.233834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a79a4-bcc2-42e9-9728-3c7c49b6bee1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:44.234270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a79a4-bcc2-42e9-9728-3c7c49b6bee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:44.234696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a79a4-bcc2-42e9-9728-3c7c49b6bee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:44.235639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a79a4-bcc2-42e9-9728-3c7c49b6bee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:44.236093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a79a4-bcc2-42e9-9728-3c7c49b6bee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:44.237626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a79a4-bcc2-42e9-9728-3c7c49b6bee1 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:44.249167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:44.253448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 258/547] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:44.259137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60da095-5673-4022-ae4b-bd2054c32eb6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:44.390553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:44.398016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60da095-5673-4022-ae4b-bd2054c32eb6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:44.453272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fecb6-dc90-4099-b0b3-37c36c141ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:44.454002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fecb6-dc90-4099-b0b3-37c36c141ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:44.454285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fecb6-dc90-4099-b0b3-37c36c141ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:44.454563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fecb6-dc90-4099-b0b3-37c36c141ed3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:44.466369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fecb6-dc90-4099-b0b3-37c36c141ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:44.467873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fecb6-dc90-4099-b0b3-37c36c141ed3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-930fecb6-dc90-4099-b0b3-37c36c141ed3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:44.491366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:44.493045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:44.494342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 290/548] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:08:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:44.495548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a79a4-bcc2-42e9-9728-3c7c49b6bee1 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:44.622461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a79a4-bcc2-42e9-9728-3c7c49b6bee1 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:44.658016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c82fa-a53b-48db-bf4c-44c430c498a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:44.658967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c82fa-a53b-48db-bf4c-44c430c498a3 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:44.659435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c82fa-a53b-48db-bf4c-44c430c498a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:44.659858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c82fa-a53b-48db-bf4c-44c430c498a3 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:44.660873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c82fa-a53b-48db-bf4c-44c430c498a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:44.661328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c82fa-a53b-48db-bf4c-44c430c498a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:44.662894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c82fa-a53b-48db-bf4c-44c430c498a3 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:44.681813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 259/549] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jun 7 14:08:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:44.687186 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fecb6-dc90-4099-b0b3-37c36c141ed3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:44.851829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fecb6-dc90-4099-b0b3-37c36c141ed3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:44.902336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e7b5-cd3a-4c15-87fa-04ed9f8fbb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:44.902996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e7b5-cd3a-4c15-87fa-04ed9f8fbb7f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:44.903283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e7b5-cd3a-4c15-87fa-04ed9f8fbb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:44.903592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e7b5-cd3a-4c15-87fa-04ed9f8fbb7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:44.941945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:44.998753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51e7b5-cd3a-4c15-87fa-04ed9f8fbb7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:45.000260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51e7b5-cd3a-4c15-87fa-04ed9f8fbb7f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:45.134539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 291/550] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:45.139924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c82fa-a53b-48db-bf4c-44c430c498a3 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:45.204697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:45.252512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb3a9-f024-48b2-a45f-2f1e02f1e73d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:45.253180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb3a9-f024-48b2-a45f-2f1e02f1e73d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:45.253854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb3a9-f024-48b2-a45f-2f1e02f1e73d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:45.255673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 292/551] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:45.260999 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325b421-4502-4c49-9a8a-6b5628a7c344 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:45.262000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325b421-4502-4c49-9a8a-6b5628a7c344 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:45.262506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325b421-4502-4c49-9a8a-6b5628a7c344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:45.268551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c82fa-a53b-48db-bf4c-44c430c498a3 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:45.281041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9325b421-4502-4c49-9a8a-6b5628a7c344 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:45.282693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9325b421-4502-4c49-9a8a-6b5628a7c344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:45.346394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769de1e-dabd-4b47-99de-1bea83154b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:45.347221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769de1e-dabd-4b47-99de-1bea83154b00 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:45.347563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769de1e-dabd-4b47-99de-1bea83154b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:45.347839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769de1e-dabd-4b47-99de-1bea83154b00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:45.364723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769de1e-dabd-4b47-99de-1bea83154b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:45.366180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769de1e-dabd-4b47-99de-1bea83154b00 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:45.369026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-5769de1e-dabd-4b47-99de-1bea83154b00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:45.393705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:45.394766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:45.395738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:45.395738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:45.395738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:45.395738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:45.396416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 260/552] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:45.403767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 293/553] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:45.404516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769de1e-dabd-4b47-99de-1bea83154b00 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:45.438189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325b421-4502-4c49-9a8a-6b5628a7c344 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:45.585898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769de1e-dabd-4b47-99de-1bea83154b00 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:45.607720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:45.615543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325b421-4502-4c49-9a8a-6b5628a7c344 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:45.657504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a1997-2848-4e69-8d9e-a84b54140a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:45.658179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a1997-2848-4e69-8d9e-a84b54140a57 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:45.658460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a1997-2848-4e69-8d9e-a84b54140a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:45.658733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a1997-2848-4e69-8d9e-a84b54140a57 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:45.659554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a1997-2848-4e69-8d9e-a84b54140a57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:45.659861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a1997-2848-4e69-8d9e-a84b54140a57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:45.664136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a1997-2848-4e69-8d9e-a84b54140a57 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:45.684963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 261/554] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:45.686628 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4638846-33bf-45c5-b57e-7d3cc3dd3a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:45.687506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4638846-33bf-45c5-b57e-7d3cc3dd3a1e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:45.687794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4638846-33bf-45c5-b57e-7d3cc3dd3a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:45.688072 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4638846-33bf-45c5-b57e-7d3cc3dd3a1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:45.691301 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a1997-2848-4e69-8d9e-a84b54140a57 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:45.717009 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4638846-33bf-45c5-b57e-7d3cc3dd3a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f4638846-33bf-45c5-b57e-7d3cc3dd3a1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:45.730904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:45.731965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:45.732811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:45.733495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 294/555] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:45.739820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4638846-33bf-45c5-b57e-7d3cc3dd3a1e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:45.825404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:45.861724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a1997-2848-4e69-8d9e-a84b54140a57 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:45.907171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee2d71-9c38-4ae6-a6f9-968df111fa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:45.908090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee2d71-9c38-4ae6-a6f9-968df111fa15 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:45.908316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee2d71-9c38-4ae6-a6f9-968df111fa15 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:45.908593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee2d71-9c38-4ae6-a6f9-968df111fa15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:45.915552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee2d71-9c38-4ae6-a6f9-968df111fa15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:45.917019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee2d71-9c38-4ae6-a6f9-968df111fa15 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:45.928859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4638846-33bf-45c5-b57e-7d3cc3dd3a1e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-b8ee2d71-9c38-4ae6-a6f9-968df111fa15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:45.933166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:45.934033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:45.935566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:45.935566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:45.935566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:45.935566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:45.935566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:45.935566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:45.935566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:45.935566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:45.935566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 262/556] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:45.936058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ae77-4b88-47be-a771-1a1caf7f14cf None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:45.936294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ae77-4b88-47be-a771-1a1caf7f14cf None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:45.936549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ae77-4b88-47be-a771-1a1caf7f14cf None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:45.942396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 263/557] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:45.943310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ae77-4b88-47be-a771-1a1caf7f14cf None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:45.975213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:45.976936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68166bf-3bff-4831-9908-2841a4214c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:45.978010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68166bf-3bff-4831-9908-2841a4214c52 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:45.978795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68166bf-3bff-4831-9908-2841a4214c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:45.979632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68166bf-3bff-4831-9908-2841a4214c52 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:45.980906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68166bf-3bff-4831-9908-2841a4214c52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:45.981469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68166bf-3bff-4831-9908-2841a4214c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:45.983617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68166bf-3bff-4831-9908-2841a4214c52 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:45.999228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 295/558] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:45.999228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69d667-fc06-45cf-837f-9bee0a193198 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:45.999228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69d667-fc06-45cf-837f-9bee0a193198 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:45.999228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69d667-fc06-45cf-837f-9bee0a193198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.013521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ef69d667-fc06-45cf-837f-9bee0a193198 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:46.014699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ef69d667-fc06-45cf-837f-9bee0a193198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:46.061475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ae77-4b88-47be-a771-1a1caf7f14cf None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:46.095358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 296/559] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:46.095358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cad87-2f0d-49a4-a23f-130d5894f1d0 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.095358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cad87-2f0d-49a4-a23f-130d5894f1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.095358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cad87-2f0d-49a4-a23f-130d5894f1d0 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.095358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 297/560] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:46.095358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cad87-2f0d-49a4-a23f-130d5894f1d0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:46.108664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a3878-b661-4cad-b600-8e3c4e730844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:46.109541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a3878-b661-4cad-b600-8e3c4e730844 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.109835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a3878-b661-4cad-b600-8e3c4e730844 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.110118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a3878-b661-4cad-b600-8e3c4e730844 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.111634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a3878-b661-4cad-b600-8e3c4e730844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:46.112352 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a3878-b661-4cad-b600-8e3c4e730844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:46.113798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a3878-b661-4cad-b600-8e3c4e730844 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:46.125968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 264/561] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:46.131328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c6001-b90d-46c1-980c-2497ef0546eb None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.131328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c6001-b90d-46c1-980c-2497ef0546eb None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.131328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c6001-b90d-46c1-980c-2497ef0546eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.138772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:46.144964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7c3c6001-b90d-46c1-980c-2497ef0546eb None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:46.146156 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7c3c6001-b90d-46c1-980c-2497ef0546eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:46.211942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cad87-2f0d-49a4-a23f-130d5894f1d0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:46.216695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 265/562] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:46.224564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c6001-b90d-46c1-980c-2497ef0546eb None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:46.248962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08abd5e-73f8-4655-8450-0afb4f578730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:46.249781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08abd5e-73f8-4655-8450-0afb4f578730 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.250065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08abd5e-73f8-4655-8450-0afb4f578730 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.250341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08abd5e-73f8-4655-8450-0afb4f578730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.251039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:46.263604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08abd5e-73f8-4655-8450-0afb4f578730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:46.265086 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08abd5e-73f8-4655-8450-0afb4f578730 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f08abd5e-73f8-4655-8450-0afb4f578730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:46.286836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:46.288041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:46.289152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:46.289152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:46.289152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:46.289152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:46.290749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 298/563] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:46.291866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08abd5e-73f8-4655-8450-0afb4f578730 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:46.352158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c6001-b90d-46c1-980c-2497ef0546eb None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:46.382062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:46.391455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28549bda-4da4-44d3-8305-3c9bb59e7213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:46.392282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28549bda-4da4-44d3-8305-3c9bb59e7213 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.392572 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28549bda-4da4-44d3-8305-3c9bb59e7213 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.392858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28549bda-4da4-44d3-8305-3c9bb59e7213 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.395713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08abd5e-73f8-4655-8450-0afb4f578730 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:46.403150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28549bda-4da4-44d3-8305-3c9bb59e7213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-28549bda-4da4-44d3-8305-3c9bb59e7213 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:46.411565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:46.412544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:46.413379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 266/564] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:46.414062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28549bda-4da4-44d3-8305-3c9bb59e7213 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:46.438457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9184375-97b8-4a7c-88d5-1e091f5ee738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:46.439288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9184375-97b8-4a7c-88d5-1e091f5ee738 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.439598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9184375-97b8-4a7c-88d5-1e091f5ee738 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.439875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9184375-97b8-4a7c-88d5-1e091f5ee738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.440710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9184375-97b8-4a7c-88d5-1e091f5ee738 None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=ee8475d17d2349559125d2bcd969b9f5) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:46.441020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9184375-97b8-4a7c-88d5-1e091f5ee738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:46.442440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9184375-97b8-4a7c-88d5-1e091f5ee738 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:46.455552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 299/565] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/role_assignments?user.id=ee8475d17d2349559125d2bcd969b9f5&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:46.457770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9184375-97b8-4a7c-88d5-1e091f5ee738 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:46.511975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:46.550897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28549bda-4da4-44d3-8305-3c9bb59e7213 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:46.586501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9184375-97b8-4a7c-88d5-1e091f5ee738 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:46.602995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce828f-81c5-4c6e-a76a-8bc7114c8d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:46.605368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce828f-81c5-4c6e-a76a-8bc7114c8d5f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.605889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce828f-81c5-4c6e-a76a-8bc7114c8d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.606362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce828f-81c5-4c6e-a76a-8bc7114c8d5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.620680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce828f-81c5-4c6e-a76a-8bc7114c8d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:46.625945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a2792-9b24-4f56-a41c-fa6fe64464ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:46.626658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2792-9b24-4f56-a41c-fa6fe64464ff None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.626949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2792-9b24-4f56-a41c-fa6fe64464ff None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.627227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a2792-9b24-4f56-a41c-fa6fe64464ff None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.628006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a2792-9b24-4f56-a41c-fa6fe64464ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:46.628313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a2792-9b24-4f56-a41c-fa6fe64464ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-4fce828f-81c5-4c6e-a76a-8bc7114c8d5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:46.628761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:46.629681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:46.635801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:46.636442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a2792-9b24-4f56-a41c-fa6fe64464ff None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:46.636524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 267/566] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:46.636524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce828f-81c5-4c6e-a76a-8bc7114c8d5f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:46.650935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 300/567] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:46.652145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04632-4af3-4035-8608-65fa57f7e3d0 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.652437 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04632-4af3-4035-8608-65fa57f7e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.652723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04632-4af3-4035-8608-65fa57f7e3d0 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.653936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 301/568] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:46.654629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd04632-4af3-4035-8608-65fa57f7e3d0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:46.671207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:46.741140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce828f-81c5-4c6e-a76a-8bc7114c8d5f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:46.761235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd04632-4af3-4035-8608-65fa57f7e3d0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:46.777186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e699362-db7e-4f76-9798-767e660d08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:46.778089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e699362-db7e-4f76-9798-767e660d08e4 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.778377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e699362-db7e-4f76-9798-767e660d08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.778779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e699362-db7e-4f76-9798-767e660d08e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.779580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e699362-db7e-4f76-9798-767e660d08e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:46.779890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e699362-db7e-4f76-9798-767e660d08e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:46.781269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e699362-db7e-4f76-9798-767e660d08e4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:46.787558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:46.792248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 268/569] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:46.793828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e699362-db7e-4f76-9798-767e660d08e4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:46.801229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1221159-d4ed-4f02-b1af-64d0e6e1961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:46.801906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1221159-d4ed-4f02-b1af-64d0e6e1961d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.802191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1221159-d4ed-4f02-b1af-64d0e6e1961d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.802472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1221159-d4ed-4f02-b1af-64d0e6e1961d None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.803224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1221159-d4ed-4f02-b1af-64d0e6e1961d None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:46.803562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1221159-d4ed-4f02-b1af-64d0e6e1961d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:46.804938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1221159-d4ed-4f02-b1af-64d0e6e1961d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:46.818619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 302/570] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:46.818619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2674cc-3c51-4a83-8631-cfc1dc4793f2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.818619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2674cc-3c51-4a83-8631-cfc1dc4793f2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.818619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2674cc-3c51-4a83-8631-cfc1dc4793f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.833685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8e2674cc-3c51-4a83-8631-cfc1dc4793f2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:46.834874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8e2674cc-3c51-4a83-8631-cfc1dc4793f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:46.903832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 303/571] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:46.904459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2674cc-3c51-4a83-8631-cfc1dc4793f2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:46.908789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:46.913829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e699362-db7e-4f76-9798-767e660d08e4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:46.960651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354ab43-9063-4765-a15c-108287f63648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:46.961459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354ab43-9063-4765-a15c-108287f63648 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:46.961747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354ab43-9063-4765-a15c-108287f63648 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:46.962027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354ab43-9063-4765-a15c-108287f63648 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:46.969395 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354ab43-9063-4765-a15c-108287f63648 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:46.971442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354ab43-9063-4765-a15c-108287f63648 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-9354ab43-9063-4765-a15c-108287f63648 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:46.986592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:46.987674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:08:46.988634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:46.992544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 269/572] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:46.993402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354ab43-9063-4765-a15c-108287f63648 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.015520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2674cc-3c51-4a83-8631-cfc1dc4793f2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.053350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187386c5-3a94-47a7-851c-032172efb182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.054153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187386c5-3a94-47a7-851c-032172efb182 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.054434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187386c5-3a94-47a7-851c-032172efb182 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.054709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187386c5-3a94-47a7-851c-032172efb182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.057475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:47.065804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187386c5-3a94-47a7-851c-032172efb182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.067247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187386c5-3a94-47a7-851c-032172efb182 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-187386c5-3a94-47a7-851c-032172efb182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:47.085658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:47.086557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:47.088356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:47.088356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:47.088356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:47.088356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:47.088356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 304/573] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:47.088356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187386c5-3a94-47a7-851c-032172efb182 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.107109 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354ab43-9063-4765-a15c-108287f63648 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.144988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ca5ec-cda1-4bde-8f18-09d6d0fd5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.145791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca5ec-cda1-4bde-8f18-09d6d0fd5690 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.146073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca5ec-cda1-4bde-8f18-09d6d0fd5690 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.146348 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca5ec-cda1-4bde-8f18-09d6d0fd5690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.152187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:47.158101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ca5ec-cda1-4bde-8f18-09d6d0fd5690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.159586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ca5ec-cda1-4bde-8f18-09d6d0fd5690 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e25ca5ec-cda1-4bde-8f18-09d6d0fd5690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:47.177679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:47.178656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:47.184401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:47.184401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:47.184401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:47.184401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:47.184401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 270/574] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:47.184401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ca5ec-cda1-4bde-8f18-09d6d0fd5690 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.207011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187386c5-3a94-47a7-851c-032172efb182 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.247207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4facdf4-6661-40be-91d4-4398a9e15772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.248060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4facdf4-6661-40be-91d4-4398a9e15772 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.248379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4facdf4-6661-40be-91d4-4398a9e15772 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.248671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4facdf4-6661-40be-91d4-4398a9e15772 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.260534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4facdf4-6661-40be-91d4-4398a9e15772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a4facdf4-6661-40be-91d4-4398a9e15772 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:47.269067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:47.270717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 305/575] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:47.271871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4facdf4-6661-40be-91d4-4398a9e15772 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.293584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ca5ec-cda1-4bde-8f18-09d6d0fd5690 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.307533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:47.332307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2c8e5-4b55-42a3-acbb-d421eddb060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.333114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2c8e5-4b55-42a3-acbb-d421eddb060a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.333579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2c8e5-4b55-42a3-acbb-d421eddb060a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.333806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2c8e5-4b55-42a3-acbb-d421eddb060a None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.334797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2c8e5-4b55-42a3-acbb-d421eddb060a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:47.335114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2c8e5-4b55-42a3-acbb-d421eddb060a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.336845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2c8e5-4b55-42a3-acbb-d421eddb060a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.355766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 271/576] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:47.356654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2c8e5-4b55-42a3-acbb-d421eddb060a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.381598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4facdf4-6661-40be-91d4-4398a9e15772 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.398572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:47.416484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e08ed-ef6c-4eba-8e28-d6edd0b8f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.417147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e08ed-ef6c-4eba-8e28-d6edd0b8f005 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.417434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e08ed-ef6c-4eba-8e28-d6edd0b8f005 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.417718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e08ed-ef6c-4eba-8e28-d6edd0b8f005 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.418446 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e08ed-ef6c-4eba-8e28-d6edd0b8f005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:47.418756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e08ed-ef6c-4eba-8e28-d6edd0b8f005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.420146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e08ed-ef6c-4eba-8e28-d6edd0b8f005 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.432520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 306/577] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:47.433287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e08ed-ef6c-4eba-8e28-d6edd0b8f005 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.463720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2c8e5-4b55-42a3-acbb-d421eddb060a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.507586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155b714-a0b6-48c7-aad2-5db6483eaec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.508258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155b714-a0b6-48c7-aad2-5db6483eaec5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.508543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155b714-a0b6-48c7-aad2-5db6483eaec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.508822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155b714-a0b6-48c7-aad2-5db6483eaec5 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.509550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155b714-a0b6-48c7-aad2-5db6483eaec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:47.509855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155b714-a0b6-48c7-aad2-5db6483eaec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.511208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155b714-a0b6-48c7-aad2-5db6483eaec5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.522713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 272/578] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:47.523740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155b714-a0b6-48c7-aad2-5db6483eaec5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.545155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e08ed-ef6c-4eba-8e28-d6edd0b8f005 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.556933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:47.586104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd163dc-4a95-494b-b549-e0af89edde06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.586887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd163dc-4a95-494b-b549-e0af89edde06 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.587235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd163dc-4a95-494b-b549-e0af89edde06 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.587620 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd163dc-4a95-494b-b549-e0af89edde06 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.588452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd163dc-4a95-494b-b549-e0af89edde06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:47.588949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd163dc-4a95-494b-b549-e0af89edde06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.590281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd163dc-4a95-494b-b549-e0af89edde06 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.598743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 307/579] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:47.599893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd163dc-4a95-494b-b549-e0af89edde06 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.641238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:47.645846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155b714-a0b6-48c7-aad2-5db6483eaec5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.684629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c701c-490a-46ee-bfd1-cb28d387a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.685429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c701c-490a-46ee-bfd1-cb28d387a480 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.685715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c701c-490a-46ee-bfd1-cb28d387a480 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.686228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c701c-490a-46ee-bfd1-cb28d387a480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.698127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c701c-490a-46ee-bfd1-cb28d387a480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.699613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c701c-490a-46ee-bfd1-cb28d387a480 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.705862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd163dc-4a95-494b-b549-e0af89edde06 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-511c701c-490a-46ee-bfd1-cb28d387a480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:47.718576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:47.719552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:47.720505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:47.720505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:47.720505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:47.720505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:47.720505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 273/580] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:47.720804 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c701c-490a-46ee-bfd1-cb28d387a480 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.747687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f024b1-1716-46b0-872b-998d181aa486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.748499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f024b1-1716-46b0-872b-998d181aa486 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.748784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f024b1-1716-46b0-872b-998d181aa486 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.749061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f024b1-1716-46b0-872b-998d181aa486 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.758500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f024b1-1716-46b0-872b-998d181aa486 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.759736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f024b1-1716-46b0-872b-998d181aa486 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-24f024b1-1716-46b0-872b-998d181aa486 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:47.774128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:47.775105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:47.776492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 308/581] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:47.777888 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f024b1-1716-46b0-872b-998d181aa486 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.813798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:47.835903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c701c-490a-46ee-bfd1-cb28d387a480 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.872465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9db68-b5f4-4196-adb8-01cf6a96d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.873289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9db68-b5f4-4196-adb8-01cf6a96d41a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.873573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9db68-b5f4-4196-adb8-01cf6a96d41a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.873850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9db68-b5f4-4196-adb8-01cf6a96d41a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.880365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:47.884052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9db68-b5f4-4196-adb8-01cf6a96d41a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.885482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9db68-b5f4-4196-adb8-01cf6a96d41a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.887601 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f024b1-1716-46b0-872b-998d181aa486 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-1bd9db68-b5f4-4196-adb8-01cf6a96d41a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:47.899931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:47.901074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:08:47.902262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:47.908248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 274/582] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:47.908248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9db68-b5f4-4196-adb8-01cf6a96d41a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:47.930219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d11d90-e32a-46c0-9978-dba1a9d5cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:47.931106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11d90-e32a-46c0-9978-dba1a9d5cb4c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:47.931496 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11d90-e32a-46c0-9978-dba1a9d5cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:47.931782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d11d90-e32a-46c0-9978-dba1a9d5cb4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:47.943275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d11d90-e32a-46c0-9978-dba1a9d5cb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:47.944748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d11d90-e32a-46c0-9978-dba1a9d5cb4c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-92d11d90-e32a-46c0-9978-dba1a9d5cb4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:47.963216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:47.964442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:47.965543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:47.965543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:47.965543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:47.965543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:47.965543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 309/583] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:47.965543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d11d90-e32a-46c0-9978-dba1a9d5cb4c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.016299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9db68-b5f4-4196-adb8-01cf6a96d41a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.053013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81d985-ee7a-4d5b-bd63-0fcf9dabf32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.053740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81d985-ee7a-4d5b-bd63-0fcf9dabf32a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.054126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81d985-ee7a-4d5b-bd63-0fcf9dabf32a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.054502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81d985-ee7a-4d5b-bd63-0fcf9dabf32a None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.055376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81d985-ee7a-4d5b-bd63-0fcf9dabf32a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:48.055781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81d985-ee7a-4d5b-bd63-0fcf9dabf32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.057242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81d985-ee7a-4d5b-bd63-0fcf9dabf32a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.069428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 275/584] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:48.070175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81d985-ee7a-4d5b-bd63-0fcf9dabf32a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.073157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:48.080218 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d11d90-e32a-46c0-9978-dba1a9d5cb4c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.116451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196275a6-fbf9-4e14-9296-12c6fcac6616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.117386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196275a6-fbf9-4e14-9296-12c6fcac6616 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.118037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196275a6-fbf9-4e14-9296-12c6fcac6616 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.118660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196275a6-fbf9-4e14-9296-12c6fcac6616 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.119598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196275a6-fbf9-4e14-9296-12c6fcac6616 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:48.119901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196275a6-fbf9-4e14-9296-12c6fcac6616 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.121448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196275a6-fbf9-4e14-9296-12c6fcac6616 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.140152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 310/585] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jun 7 14:08:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:48.141274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196275a6-fbf9-4e14-9296-12c6fcac6616 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.152373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:48.184120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81d985-ee7a-4d5b-bd63-0fcf9dabf32a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.220344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266d9c7-9837-4d86-9e30-5fc35f91b250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.221518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266d9c7-9837-4d86-9e30-5fc35f91b250 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.221802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266d9c7-9837-4d86-9e30-5fc35f91b250 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.222087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266d9c7-9837-4d86-9e30-5fc35f91b250 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.223027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266d9c7-9837-4d86-9e30-5fc35f91b250 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:48.223361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266d9c7-9837-4d86-9e30-5fc35f91b250 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.224795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266d9c7-9837-4d86-9e30-5fc35f91b250 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.247427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 276/586] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:48.247427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266d9c7-9837-4d86-9e30-5fc35f91b250 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.259762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196275a6-fbf9-4e14-9296-12c6fcac6616 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.296779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbde1c8-0483-4075-bd27-4454470e6f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.297435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbde1c8-0483-4075-bd27-4454470e6f29 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.297722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbde1c8-0483-4075-bd27-4454470e6f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.297997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbde1c8-0483-4075-bd27-4454470e6f29 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.298749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbde1c8-0483-4075-bd27-4454470e6f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:48.299058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbde1c8-0483-4075-bd27-4454470e6f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.300438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbde1c8-0483-4075-bd27-4454470e6f29 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.308117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:48.317791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 311/587] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:48.317791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbde1c8-0483-4075-bd27-4454470e6f29 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.355754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266d9c7-9837-4d86-9e30-5fc35f91b250 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.388173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:48.394496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595427bd-4a8d-4cae-8366-81c65ec8843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.395293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595427bd-4a8d-4cae-8366-81c65ec8843c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.395605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595427bd-4a8d-4cae-8366-81c65ec8843c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.395878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595427bd-4a8d-4cae-8366-81c65ec8843c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.403047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595427bd-4a8d-4cae-8366-81c65ec8843c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.404742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595427bd-4a8d-4cae-8366-81c65ec8843c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-595427bd-4a8d-4cae-8366-81c65ec8843c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:48.419931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:48.420836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 277/588] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:48.426644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595427bd-4a8d-4cae-8366-81c65ec8843c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.429667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbde1c8-0483-4075-bd27-4454470e6f29 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.464791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bae32-075e-44ee-b931-422b3c48f1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.465691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bae32-075e-44ee-b931-422b3c48f1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.466038 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bae32-075e-44ee-b931-422b3c48f1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.466373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962bae32-075e-44ee-b931-422b3c48f1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.476763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bae32-075e-44ee-b931-422b3c48f1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.478280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962bae32-075e-44ee-b931-422b3c48f1b9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-962bae32-075e-44ee-b931-422b3c48f1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:48.502850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:48.503926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:48.505100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:48.505100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:48.505100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:48.505100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:48.506939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 312/589] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:48.507917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bae32-075e-44ee-b931-422b3c48f1b9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.537540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595427bd-4a8d-4cae-8366-81c65ec8843c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.558644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:48.573825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e4695-17d9-4afc-9a9b-7c0265227984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.574699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e4695-17d9-4afc-9a9b-7c0265227984 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.575054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e4695-17d9-4afc-9a9b-7c0265227984 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.575426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e4695-17d9-4afc-9a9b-7c0265227984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.585907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e4695-17d9-4afc-9a9b-7c0265227984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.587432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e4695-17d9-4afc-9a9b-7c0265227984 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-1e5e4695-17d9-4afc-9a9b-7c0265227984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:48.604662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:48.605774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:48.606896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:48.606896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:48.606896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:48.606896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:48.610633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 278/590] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:48.611571 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e4695-17d9-4afc-9a9b-7c0265227984 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.616920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962bae32-075e-44ee-b931-422b3c48f1b9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.638375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:48.654470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854233-6e5d-4483-997a-cf3189d04d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.655644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854233-6e5d-4483-997a-cf3189d04d3b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.655904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854233-6e5d-4483-997a-cf3189d04d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.656359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0854233-6e5d-4483-997a-cf3189d04d3b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.664550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854233-6e5d-4483-997a-cf3189d04d3b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.666201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0854233-6e5d-4483-997a-cf3189d04d3b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f0854233-6e5d-4483-997a-cf3189d04d3b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:48.680806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:48.681939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 313/591] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:48.683104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854233-6e5d-4483-997a-cf3189d04d3b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.715791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e4695-17d9-4afc-9a9b-7c0265227984 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.748126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2e85-044b-47ee-afc7-5b122957c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.748782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2e85-044b-47ee-afc7-5b122957c1bb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.749063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2e85-044b-47ee-afc7-5b122957c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.749335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2e85-044b-47ee-afc7-5b122957c1bb None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.750122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce2e85-044b-47ee-afc7-5b122957c1bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:48.750430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce2e85-044b-47ee-afc7-5b122957c1bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.752422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce2e85-044b-47ee-afc7-5b122957c1bb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.764980 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 279/592] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:48.765764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2e85-044b-47ee-afc7-5b122957c1bb None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.784492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0854233-6e5d-4483-997a-cf3189d04d3b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.796248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:48.817748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee9d8-9929-4ce8-8215-03244a574fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.818341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee9d8-9929-4ce8-8215-03244a574fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.818624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee9d8-9929-4ce8-8215-03244a574fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.818903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee9d8-9929-4ce8-8215-03244a574fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.819660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ee9d8-9929-4ce8-8215-03244a574fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:48.819969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ee9d8-9929-4ce8-8215-03244a574fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.821335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ee9d8-9929-4ce8-8215-03244a574fc1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.833796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 314/593] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:48.833796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41d08a-923e-417c-afc4-dbcb5aa28d2a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.833796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41d08a-923e-417c-afc4-dbcb5aa28d2a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.833796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41d08a-923e-417c-afc4-dbcb5aa28d2a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.833796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 315/594] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:48.833796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41d08a-923e-417c-afc4-dbcb5aa28d2a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.866435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2e85-044b-47ee-afc7-5b122957c1bb None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.880810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:48.901197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea925f-d1da-48b7-b92a-62dfa409dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.901856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea925f-d1da-48b7-b92a-62dfa409dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.902139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea925f-d1da-48b7-b92a-62dfa409dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.902416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea925f-d1da-48b7-b92a-62dfa409dbe3 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.903146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea925f-d1da-48b7-b92a-62dfa409dbe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:48.903482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea925f-d1da-48b7-b92a-62dfa409dbe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.904834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea925f-d1da-48b7-b92a-62dfa409dbe3 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.916223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 280/595] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:48.916977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea925f-d1da-48b7-b92a-62dfa409dbe3 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:48.943725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41d08a-923e-417c-afc4-dbcb5aa28d2a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:48.977684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f81b8-42d2-4cea-88b4-9e82ffbafdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:48.978349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f81b8-42d2-4cea-88b4-9e82ffbafdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:48.978632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f81b8-42d2-4cea-88b4-9e82ffbafdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:48.978914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f81b8-42d2-4cea-88b4-9e82ffbafdb1 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:48.979780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f81b8-42d2-4cea-88b4-9e82ffbafdb1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:48.980086 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f81b8-42d2-4cea-88b4-9e82ffbafdb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:48.981538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f81b8-42d2-4cea-88b4-9e82ffbafdb1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:48.998170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 316/596] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:48.998963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f81b8-42d2-4cea-88b4-9e82ffbafdb1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.004632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:49.013897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea925f-d1da-48b7-b92a-62dfa409dbe3 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.047362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe847cc-b9a1-46e6-9fab-08a50d19654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.048267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe847cc-b9a1-46e6-9fab-08a50d19654e None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.049081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe847cc-b9a1-46e6-9fab-08a50d19654e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.049353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe847cc-b9a1-46e6-9fab-08a50d19654e None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/dbba49c3d7c24cd699d85fb93c76e7fe/roles/f1f290999a44482b8242439dfe27b3e2` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.063230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe847cc-b9a1-46e6-9fab-08a50d19654e None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=dbba49c3d7c24cd699d85fb93c76e7fe, role_id=f1f290999a44482b8242439dfe27b3e2)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:49.064744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe847cc-b9a1-46e6-9fab-08a50d19654e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:49.077342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 281/597] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:08:48 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/dbba49c3d7c24cd699d85fb93c76e7fe/roles/f1f290999a44482b8242439dfe27b3e2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:49.091612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c44ca-dfae-4b06-bfdc-a7152eafcb53 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.091612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c44ca-dfae-4b06-bfdc-a7152eafcb53 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.091612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c44ca-dfae-4b06-bfdc-a7152eafcb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.097072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-c38c44ca-dfae-4b06-bfdc-a7152eafcb53 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:49.097273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:49.098343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c38c44ca-dfae-4b06-bfdc-a7152eafcb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:49.101914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f81b8-42d2-4cea-88b4-9e82ffbafdb1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.141110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf0f11-8a7f-46f5-a6d6-bffd7091cc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.142561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf0f11-8a7f-46f5-a6d6-bffd7091cc7a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.142913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf0f11-8a7f-46f5-a6d6-bffd7091cc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.143254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf0f11-8a7f-46f5-a6d6-bffd7091cc7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.151690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf0f11-8a7f-46f5-a6d6-bffd7091cc7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:49.153364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf0f11-8a7f-46f5-a6d6-bffd7091cc7a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-36cf0f11-8a7f-46f5-a6d6-bffd7091cc7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:49.168810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:49.169985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:49.171060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:49.171060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:49.171060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:49.171060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:49.171060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:49.171060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:49.171060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:49.171060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:49.171060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 317/598] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:49.176177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf0f11-8a7f-46f5-a6d6-bffd7091cc7a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.187401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 282/599] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:49.187401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c44ca-dfae-4b06-bfdc-a7152eafcb53 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.278653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:49.297250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf0f11-8a7f-46f5-a6d6-bffd7091cc7a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.311380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c44ca-dfae-4b06-bfdc-a7152eafcb53 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.332861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6c189-7683-4da3-b7a6-6fa5e9961b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.333582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6c189-7683-4da3-b7a6-6fa5e9961b46 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.333872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6c189-7683-4da3-b7a6-6fa5e9961b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.334139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6c189-7683-4da3-b7a6-6fa5e9961b46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.340757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6c189-7683-4da3-b7a6-6fa5e9961b46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:49.342188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6c189-7683-4da3-b7a6-6fa5e9961b46 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:49.348136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116f374-7769-48de-bd16-1e0cade55298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.348935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116f374-7769-48de-bd16-1e0cade55298 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.349217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116f374-7769-48de-bd16-1e0cade55298 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.349490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116f374-7769-48de-bd16-1e0cade55298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-73d6c189-7683-4da3-b7a6-6fa5e9961b46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:49.356978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:49.357911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:49.358804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:49.358804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:49.358804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:49.358804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:49.358804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:49.358804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:49.358804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:49.358804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:49.358804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 318/600] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:49.359284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6c189-7683-4da3-b7a6-6fa5e9961b46 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.364717 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116f374-7769-48de-bd16-1e0cade55298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:49.366173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116f374-7769-48de-bd16-1e0cade55298 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:49.380584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-3116f374-7769-48de-bd16-1e0cade55298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:49.384329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:49.385252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:49.386135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:49.386135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:49.386135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:49.386135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:49.386135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 283/601] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:49.386416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116f374-7769-48de-bd16-1e0cade55298 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.474890 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6c189-7683-4da3-b7a6-6fa5e9961b46 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.494748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116f374-7769-48de-bd16-1e0cade55298 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.517294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1c675-e52e-421d-a6ce-e578ae544c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.518081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c675-e52e-421d-a6ce-e578ae544c8a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.518459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c675-e52e-421d-a6ce-e578ae544c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.518830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c675-e52e-421d-a6ce-e578ae544c8a None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.519757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1c675-e52e-421d-a6ce-e578ae544c8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:49.520163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1c675-e52e-421d-a6ce-e578ae544c8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:49.521643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:49.521757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1c675-e52e-421d-a6ce-e578ae544c8a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:49.533756 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71892-ae1c-4477-b40f-e3ac051d52b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.539110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 319/602] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:49.539261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71892-ae1c-4477-b40f-e3ac051d52b0 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.539261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71892-ae1c-4477-b40f-e3ac051d52b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.539261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71892-ae1c-4477-b40f-e3ac051d52b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.539538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1c675-e52e-421d-a6ce-e578ae544c8a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.550436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71892-ae1c-4477-b40f-e3ac051d52b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-20a71892-ae1c-4477-b40f-e3ac051d52b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:49.558810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:49.559936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:49.560978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:49.567136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 284/603] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:49.567136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71892-ae1c-4477-b40f-e3ac051d52b0 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.630327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:49.653586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1c675-e52e-421d-a6ce-e578ae544c8a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.669697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71892-ae1c-4477-b40f-e3ac051d52b0 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.689603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf780a-27c0-4bb4-bca7-19dea3213271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.690406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf780a-27c0-4bb4-bca7-19dea3213271 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.690757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf780a-27c0-4bb4-bca7-19dea3213271 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.691099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf780a-27c0-4bb4-bca7-19dea3213271 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.691970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf780a-27c0-4bb4-bca7-19dea3213271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:49.692275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf780a-27c0-4bb4-bca7-19dea3213271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:49.693935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf780a-27c0-4bb4-bca7-19dea3213271 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:49.707756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 320/604] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:49.708787 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf780a-27c0-4bb4-bca7-19dea3213271 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.717326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1fc2b-66a0-4ff0-bf61-8ddbffce7381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.717991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1fc2b-66a0-4ff0-bf61-8ddbffce7381 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.718275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1fc2b-66a0-4ff0-bf61-8ddbffce7381 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.718549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1fc2b-66a0-4ff0-bf61-8ddbffce7381 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.719277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1fc2b-66a0-4ff0-bf61-8ddbffce7381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:49.719635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1fc2b-66a0-4ff0-bf61-8ddbffce7381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:49.721040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1fc2b-66a0-4ff0-bf61-8ddbffce7381 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:49.733063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 285/605] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:49.737090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1fc2b-66a0-4ff0-bf61-8ddbffce7381 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.784903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:49.815880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf780a-27c0-4bb4-bca7-19dea3213271 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.845031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1fc2b-66a0-4ff0-bf61-8ddbffce7381 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:49.856632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb1e66-4d30-4a28-af2b-e27129f89f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.857780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb1e66-4d30-4a28-af2b-e27129f89f8d None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.858060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb1e66-4d30-4a28-af2b-e27129f89f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.858332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb1e66-4d30-4a28-af2b-e27129f89f8d None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/e1ea02cd5e644aaba236acf4e46cb20f/roles/f1f290999a44482b8242439dfe27b3e2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.869621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:49.878037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb1e66-4d30-4a28-af2b-e27129f89f8d None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=e1ea02cd5e644aaba236acf4e46cb20f, role_id=f1f290999a44482b8242439dfe27b3e2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:49.879496 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb1e66-4d30-4a28-af2b-e27129f89f8d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:49.882498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10390e-c4ca-4130-8271-c2f09a02486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:49.883114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10390e-c4ca-4130-8271-c2f09a02486b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:49.883419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10390e-c4ca-4130-8271-c2f09a02486b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:49.883726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10390e-c4ca-4130-8271-c2f09a02486b None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:49.884511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10390e-c4ca-4130-8271-c2f09a02486b None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:49.884820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10390e-c4ca-4130-8271-c2f09a02486b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:49.886255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10390e-c4ca-4130-8271-c2f09a02486b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:49.899655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 321/606] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:08:49 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/e1ea02cd5e644aaba236acf4e46cb20f/roles/f1f290999a44482b8242439dfe27b3e2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:49.899853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 286/607] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:49.899853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10390e-c4ca-4130-8271-c2f09a02486b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:49.902538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb1e66-4d30-4a28-af2b-e27129f89f8d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:50.024345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb1e66-4d30-4a28-af2b-e27129f89f8d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:50.046655 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10390e-c4ca-4130-8271-c2f09a02486b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:50.055127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:50.077025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffce29a-7376-43a1-9795-33922dbeb9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:50.078051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffce29a-7376-43a1-9795-33922dbeb9fe None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:50.078589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffce29a-7376-43a1-9795-33922dbeb9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:50.078865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffce29a-7376-43a1-9795-33922dbeb9fe None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/a418c5817e784d299c8d6daad20c6cdb/roles/f1f290999a44482b8242439dfe27b3e2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:50.087802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c21c3-e612-44c1-a872-acc7d3a9c67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:50.088612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c21c3-e612-44c1-a872-acc7d3a9c67f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:50.088951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c21c3-e612-44c1-a872-acc7d3a9c67f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:50.089234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c21c3-e612-44c1-a872-acc7d3a9c67f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:50.099346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c21c3-e612-44c1-a872-acc7d3a9c67f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:50.102001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c21c3-e612-44c1-a872-acc7d3a9c67f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:50.106259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffce29a-7376-43a1-9795-33922dbeb9fe None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=a418c5817e784d299c8d6daad20c6cdb, role_id=f1f290999a44482b8242439dfe27b3e2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:50.107723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffce29a-7376-43a1-9795-33922dbeb9fe None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:50.124964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 322/608] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:08:49 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/a418c5817e784d299c8d6daad20c6cdb/roles/f1f290999a44482b8242439dfe27b3e2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:08:50.125794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffce29a-7376-43a1-9795-33922dbeb9fe None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-262c21c3-e612-44c1-a872-acc7d3a9c67f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:50.126081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:50.127687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:50.128570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:50.128570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:50.128570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:50.128570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:50.128570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:50.128570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:50.128570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:50.128570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:50.134159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 287/609] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:50.135525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c21c3-e612-44c1-a872-acc7d3a9c67f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:50.189677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:50.265976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c21c3-e612-44c1-a872-acc7d3a9c67f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:50.319078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a674c-ef47-406f-baf3-9e17ff759091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:50.320417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a674c-ef47-406f-baf3-9e17ff759091 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:50.320910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a674c-ef47-406f-baf3-9e17ff759091 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:50.322011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a674c-ef47-406f-baf3-9e17ff759091 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:50.323055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a674c-ef47-406f-baf3-9e17ff759091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:50.323623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a674c-ef47-406f-baf3-9e17ff759091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:50.325293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a674c-ef47-406f-baf3-9e17ff759091 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:50.345683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 288/610] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:50.350954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffce29a-7376-43a1-9795-33922dbeb9fe None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:50.352204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a674c-ef47-406f-baf3-9e17ff759091 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:50.391900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ced057-dbcc-4a63-99bd-38b1d2289c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:50.393417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:50.393560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced057-dbcc-4a63-99bd-38b1d2289c85 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:50.393880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced057-dbcc-4a63-99bd-38b1d2289c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:50.394242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced057-dbcc-4a63-99bd-38b1d2289c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:50.406284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ced057-dbcc-4a63-99bd-38b1d2289c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:50.407963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ced057-dbcc-4a63-99bd-38b1d2289c85 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a3ced057-dbcc-4a63-99bd-38b1d2289c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:50.428735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:50.429861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:50.430956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:50.430956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:50.430956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:50.430956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:50.432433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 323/611] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:50.437632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ced057-dbcc-4a63-99bd-38b1d2289c85 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:50.482558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a674c-ef47-406f-baf3-9e17ff759091 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:50.534496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd2a8-27ae-44ff-aa8d-198324d364a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:50.535857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd2a8-27ae-44ff-aa8d-198324d364a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:50.536238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd2a8-27ae-44ff-aa8d-198324d364a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:50.536612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd2a8-27ae-44ff-aa8d-198324d364a4 None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/fafd295a115c4f5d912e49d6a21d67b3/roles/f1f290999a44482b8242439dfe27b3e2` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:50.554343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdd2a8-27ae-44ff-aa8d-198324d364a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=fafd295a115c4f5d912e49d6a21d67b3, role_id=f1f290999a44482b8242439dfe27b3e2)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:50.556083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdd2a8-27ae-44ff-aa8d-198324d364a4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:50.572851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 289/612] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:08:50 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/fafd295a115c4f5d912e49d6a21d67b3/roles/f1f290999a44482b8242439dfe27b3e2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:08:50.591259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:50.603020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ced057-dbcc-4a63-99bd-38b1d2289c85 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:50.646595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494d3b-85df-4694-b706-4159a4c264b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:50.647375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494d3b-85df-4694-b706-4159a4c264b1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:50.647769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494d3b-85df-4694-b706-4159a4c264b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:50.648142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494d3b-85df-4694-b706-4159a4c264b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:50.648981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494d3b-85df-4694-b706-4159a4c264b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:50.649383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494d3b-85df-4694-b706-4159a4c264b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:50.650889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494d3b-85df-4694-b706-4159a4c264b1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:50.664539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 324/613] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:50.670012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd2a8-27ae-44ff-aa8d-198324d364a4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:50.767571 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:50.801027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdd2a8-27ae-44ff-aa8d-198324d364a4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:50.852873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b5615-ec75-40ed-85d9-3d1a4d37bfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:50.853701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b5615-ec75-40ed-85d9-3d1a4d37bfcf None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:50.853987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b5615-ec75-40ed-85d9-3d1a4d37bfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:50.854256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b5615-ec75-40ed-85d9-3d1a4d37bfcf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:50.868786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b5615-ec75-40ed-85d9-3d1a4d37bfcf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:50.870257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b5615-ec75-40ed-85d9-3d1a4d37bfcf None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-3e1b5615-ec75-40ed-85d9-3d1a4d37bfcf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:50.892088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:50.893110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:50.894046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 290/614] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:08:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:50.900954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494d3b-85df-4694-b706-4159a4c264b1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:51.007984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494d3b-85df-4694-b706-4159a4c264b1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:51.050515 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75fb7c-a9d4-43ab-a3f3-33c65a7eb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:51.051191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75fb7c-a9d4-43ab-a3f3-33c65a7eb0ef None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:51.051498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75fb7c-a9d4-43ab-a3f3-33c65a7eb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:51.051774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75fb7c-a9d4-43ab-a3f3-33c65a7eb0ef None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:51.052619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75fb7c-a9d4-43ab-a3f3-33c65a7eb0ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:51.052930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75fb7c-a9d4-43ab-a3f3-33c65a7eb0ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:51.054359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75fb7c-a9d4-43ab-a3f3-33c65a7eb0ef None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:51.081619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 325/615] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jun 7 14:08:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:51.086976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b5615-ec75-40ed-85d9-3d1a4d37bfcf None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:51.205552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b5615-ec75-40ed-85d9-3d1a4d37bfcf None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:51.253328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41d7b0-befc-4154-8922-f4d96ce07d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:51.254133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41d7b0-befc-4154-8922-f4d96ce07d7c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:51.254413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41d7b0-befc-4154-8922-f4d96ce07d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:51.254695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41d7b0-befc-4154-8922-f4d96ce07d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:51.258912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:51.270884 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41d7b0-befc-4154-8922-f4d96ce07d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:51.272346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41d7b0-befc-4154-8922-f4d96ce07d7c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-1e41d7b0-befc-4154-8922-f4d96ce07d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:51.293982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:51.294889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:51.295830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:51.295830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:51.295830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:51.295830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:51.295830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 291/616] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:51.302179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75fb7c-a9d4-43ab-a3f3-33c65a7eb0ef None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:51.314778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:51.416113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75fb7c-a9d4-43ab-a3f3-33c65a7eb0ef None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:51.451675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cfe8c-870f-4c9a-aa96-fde3e5a3ec82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:51.452403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cfe8c-870f-4c9a-aa96-fde3e5a3ec82 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:51.452684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cfe8c-870f-4c9a-aa96-fde3e5a3ec82 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:51.452959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cfe8c-870f-4c9a-aa96-fde3e5a3ec82 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:51.453725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cfe8c-870f-4c9a-aa96-fde3e5a3ec82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:51.454036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cfe8c-870f-4c9a-aa96-fde3e5a3ec82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:51.456055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cfe8c-870f-4c9a-aa96-fde3e5a3ec82 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:51.468050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 326/617] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:51.476421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41d7b0-befc-4154-8922-f4d96ce07d7c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:51.598356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41d7b0-befc-4154-8922-f4d96ce07d7c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:51.636028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ab623-ee41-4525-a769-edf48a61ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:51.636829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ab623-ee41-4525-a769-edf48a61ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:51.637109 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ab623-ee41-4525-a769-edf48a61ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:51.637383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ab623-ee41-4525-a769-edf48a61ccb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:51.648546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ab623-ee41-4525-a769-edf48a61ccb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:51.650000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ab623-ee41-4525-a769-edf48a61ccb5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:51.654274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a829f-433c-4e8d-b12e-83fbaea49263 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:51.654560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a829f-433c-4e8d-b12e-83fbaea49263 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:51.654835 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a829f-433c-4e8d-b12e-83fbaea49263 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:51.656344 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 327/618] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-c99ab623-ee41-4525-a769-edf48a61ccb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:51.669899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:51.670824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:51.671963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:51.671963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:51.671963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:51.671963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:51.671963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:51.671963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:51.671963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:51.671963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:51.671963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 292/619] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:51.676558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a829f-433c-4e8d-b12e-83fbaea49263 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:51.689934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9dbc5-dc40-452e-b48c-a5bc44229be9 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:51.690222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9dbc5-dc40-452e-b48c-a5bc44229be9 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:51.690499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9dbc5-dc40-452e-b48c-a5bc44229be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:51.728500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8fc9dbc5-dc40-452e-b48c-a5bc44229be9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:51.729784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8fc9dbc5-dc40-452e-b48c-a5bc44229be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:51.799658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:51.804294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:51.850127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 293/620] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:51.860354 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a829f-433c-4e8d-b12e-83fbaea49263 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:51.898615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9dbc5-dc40-452e-b48c-a5bc44229be9 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:51.909701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d9a05-12e9-4e95-8e2d-f43c68a2e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:51.911638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d9a05-12e9-4e95-8e2d-f43c68a2e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:51.911942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d9a05-12e9-4e95-8e2d-f43c68a2e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:51.912225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d9a05-12e9-4e95-8e2d-f43c68a2e4b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:51.913041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d9a05-12e9-4e95-8e2d-f43c68a2e4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:51.913354 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d9a05-12e9-4e95-8e2d-f43c68a2e4b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:51.914789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d9a05-12e9-4e95-8e2d-f43c68a2e4b4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:51.931442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 328/621] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:51.933638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d9a05-12e9-4e95-8e2d-f43c68a2e4b4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:52.043220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9dbc5-dc40-452e-b48c-a5bc44229be9 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:52.080567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728ceff-8c97-4af9-ac73-c4999e2dd1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:52.081367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728ceff-8c97-4af9-ac73-c4999e2dd1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:52.081644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728ceff-8c97-4af9-ac73-c4999e2dd1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:52.081913 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728ceff-8c97-4af9-ac73-c4999e2dd1f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:52.101635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728ceff-8c97-4af9-ac73-c4999e2dd1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-4728ceff-8c97-4af9-ac73-c4999e2dd1f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:52.114410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:52.115396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:52.116259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:52.117370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d9a05-12e9-4e95-8e2d-f43c68a2e4b4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:52.119583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 294/622] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:52.127358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728ceff-8c97-4af9-ac73-c4999e2dd1f5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:52.168256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:52.181967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf33e9-1236-454d-af5c-d15146cc6d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:52.182860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf33e9-1236-454d-af5c-d15146cc6d13 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:52.183138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf33e9-1236-454d-af5c-d15146cc6d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:52.183432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf33e9-1236-454d-af5c-d15146cc6d13 None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/ee8475d17d2349559125d2bcd969b9f5/roles/f1f290999a44482b8242439dfe27b3e2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:52.200295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf33e9-1236-454d-af5c-d15146cc6d13 None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=ee8475d17d2349559125d2bcd969b9f5, role_id=f1f290999a44482b8242439dfe27b3e2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:52.201749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf33e9-1236-454d-af5c-d15146cc6d13 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:52.211208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:52.222757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 329/623] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:08:51 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/ee8475d17d2349559125d2bcd969b9f5/roles/f1f290999a44482b8242439dfe27b3e2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:08:52.321530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728ceff-8c97-4af9-ac73-c4999e2dd1f5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:52.362047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74fb3e-dca6-492e-90a7-b7d9fddb3c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:52.362738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74fb3e-dca6-492e-90a7-b7d9fddb3c61 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:52.363022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74fb3e-dca6-492e-90a7-b7d9fddb3c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:52.363297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74fb3e-dca6-492e-90a7-b7d9fddb3c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:52.364095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74fb3e-dca6-492e-90a7-b7d9fddb3c61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:52.364402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74fb3e-dca6-492e-90a7-b7d9fddb3c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:52.365798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74fb3e-dca6-492e-90a7-b7d9fddb3c61 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:52.382746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 295/624] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:52.388451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf33e9-1236-454d-af5c-d15146cc6d13 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:52.526312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf33e9-1236-454d-af5c-d15146cc6d13 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:52.561394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058cb28-2ddf-483f-a1fb-5a9cd70318c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:52.562189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058cb28-2ddf-483f-a1fb-5a9cd70318c1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:52.562475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058cb28-2ddf-483f-a1fb-5a9cd70318c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:52.562754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058cb28-2ddf-483f-a1fb-5a9cd70318c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:52.574151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058cb28-2ddf-483f-a1fb-5a9cd70318c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:52.575569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058cb28-2ddf-483f-a1fb-5a9cd70318c1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a058cb28-2ddf-483f-a1fb-5a9cd70318c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:52.594310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:52.595265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:52.596202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:52.596202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:52.596202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:52.596202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:52.596202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 330/625] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:52.601029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74fb3e-dca6-492e-90a7-b7d9fddb3c61 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:52.711530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349acd-7575-49f7-830d-ba44fb04225f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:52.711855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349acd-7575-49f7-830d-ba44fb04225f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:52.712082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349acd-7575-49f7-830d-ba44fb04225f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:52.713673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 331/626] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:08:52.718450 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675d5b9-6c34-4ff9-8e3b-6fb1de4cdc72 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:52.718742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675d5b9-6c34-4ff9-8e3b-6fb1de4cdc72 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:52.719017 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675d5b9-6c34-4ff9-8e3b-6fb1de4cdc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:52.736532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d675d5b9-6c34-4ff9-8e3b-6fb1de4cdc72 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:52.737713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d675d5b9-6c34-4ff9-8e3b-6fb1de4cdc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:52.766531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74fb3e-dca6-492e-90a7-b7d9fddb3c61 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:52.768686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:52.776887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:52.820355 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6472366-2ffb-49f1-a16b-b3c202e67306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:52.821034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472366-2ffb-49f1-a16b-b3c202e67306 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:52.821560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472366-2ffb-49f1-a16b-b3c202e67306 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:52.821833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6472366-2ffb-49f1-a16b-b3c202e67306 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:52.822557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6472366-2ffb-49f1-a16b-b3c202e67306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:52.822858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6472366-2ffb-49f1-a16b-b3c202e67306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:52.824299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6472366-2ffb-49f1-a16b-b3c202e67306 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:52.845711 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 296/627] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:52.850829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6472366-2ffb-49f1-a16b-b3c202e67306 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:52.869591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 332/628] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:08:52.916603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675d5b9-6c34-4ff9-8e3b-6fb1de4cdc72 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:53.031244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6472366-2ffb-49f1-a16b-b3c202e67306 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:53.062753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675d5b9-6c34-4ff9-8e3b-6fb1de4cdc72 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:53.069806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be333a-c2bf-4613-ac18-2091d9a76821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:53.071116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be333a-c2bf-4613-ac18-2091d9a76821 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.071743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be333a-c2bf-4613-ac18-2091d9a76821 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.072021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be333a-c2bf-4613-ac18-2091d9a76821 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.079615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be333a-c2bf-4613-ac18-2091d9a76821 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:53.080982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be333a-c2bf-4613-ac18-2091d9a76821 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-c1be333a-c2bf-4613-ac18-2091d9a76821 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:53.096113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:53.097146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:53.098087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 297/629] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:53.099153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f44f-e6b7-4359-a5ad-04cb85e8fee1 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.099306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f44f-e6b7-4359-a5ad-04cb85e8fee1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.103380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f44f-e6b7-4359-a5ad-04cb85e8fee1 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.104984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 298/630] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:53.105839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24f44f-e6b7-4359-a5ad-04cb85e8fee1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:53.107415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583661d-47c3-4f48-bb84-cac759561313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:53.108394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583661d-47c3-4f48-bb84-cac759561313 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.109127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583661d-47c3-4f48-bb84-cac759561313 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.110602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583661d-47c3-4f48-bb84-cac759561313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.126638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583661d-47c3-4f48-bb84-cac759561313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:53.129347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2583661d-47c3-4f48-bb84-cac759561313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:53.139868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:53.141005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:53.142092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:53.149854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 333/631] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:53.149854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac031-d62c-4cc2-b70c-0759e3e99d35 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.149854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac031-d62c-4cc2-b70c-0759e3e99d35 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.149854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cac031-d62c-4cc2-b70c-0759e3e99d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.169796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e7cac031-d62c-4cc2-b70c-0759e3e99d35 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:53.170998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e7cac031-d62c-4cc2-b70c-0759e3e99d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:53.188652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:53.248034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24f44f-e6b7-4359-a5ad-04cb85e8fee1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:53.255383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 334/632] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:53.255383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac031-d62c-4cc2-b70c-0759e3e99d35 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:53.308476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffe7eb-16e0-4d11-9709-171ded90b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:53.309588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffe7eb-16e0-4d11-9709-171ded90b738 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.309973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffe7eb-16e0-4d11-9709-171ded90b738 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.310349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffe7eb-16e0-4d11-9709-171ded90b738 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.311587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffe7eb-16e0-4d11-9709-171ded90b738 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:53.312000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffe7eb-16e0-4d11-9709-171ded90b738 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:53.314416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffe7eb-16e0-4d11-9709-171ded90b738 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:53.340867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 299/633] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jun 7 14:08:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:53.341780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffe7eb-16e0-4d11-9709-171ded90b738 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:53.369828 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cac031-d62c-4cc2-b70c-0759e3e99d35 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:53.405530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458f649-dc2d-4398-b280-ab473ceddcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:53.406439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458f649-dc2d-4398-b280-ab473ceddcfc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.406861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458f649-dc2d-4398-b280-ab473ceddcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.407301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458f649-dc2d-4398-b280-ab473ceddcfc None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.408771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458f649-dc2d-4398-b280-ab473ceddcfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:53.409232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458f649-dc2d-4398-b280-ab473ceddcfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:53.410718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458f649-dc2d-4398-b280-ab473ceddcfc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:53.419982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 335/634] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:53.421047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458f649-dc2d-4398-b280-ab473ceddcfc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:53.437252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:53.451278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:53.487600 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffe7eb-16e0-4d11-9709-171ded90b738 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:53.529478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4312e8-918d-4b15-92f0-5d20a265ce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:53.530275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4312e8-918d-4b15-92f0-5d20a265ce85 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.530556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4312e8-918d-4b15-92f0-5d20a265ce85 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.530827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4312e8-918d-4b15-92f0-5d20a265ce85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.541563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4312e8-918d-4b15-92f0-5d20a265ce85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:53.545764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458f649-dc2d-4398-b280-ab473ceddcfc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-af4312e8-918d-4b15-92f0-5d20a265ce85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:53.549203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:53.550117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:53.550951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 300/635] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:53.552360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4312e8-918d-4b15-92f0-5d20a265ce85 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:53.588498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd09c00-125e-4099-b6ca-4e6660dd1101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:53.588915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd09c00-125e-4099-b6ca-4e6660dd1101 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.589203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd09c00-125e-4099-b6ca-4e6660dd1101 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.589482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd09c00-125e-4099-b6ca-4e6660dd1101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.660907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4312e8-918d-4b15-92f0-5d20a265ce85 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:53.666335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd09c00-125e-4099-b6ca-4e6660dd1101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:53.668121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd09c00-125e-4099-b6ca-4e6660dd1101 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:53.683021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:53.695990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacb1af-1f47-4d70-859e-83589f2f7bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:53.697051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacb1af-1f47-4d70-859e-83589f2f7bfc None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.697330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacb1af-1f47-4d70-859e-83589f2f7bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.697599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacb1af-1f47-4d70-859e-83589f2f7bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.706139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:53.711103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacb1af-1f47-4d70-859e-83589f2f7bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:53.712587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacb1af-1f47-4d70-859e-83589f2f7bfc None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-ceacb1af-1f47-4d70-859e-83589f2f7bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:53.730170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:53.731139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:53.732220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:53.732220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:53.732220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:53.732220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:53.733741 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 301/636] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:53.735093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6fae-69b4-4f8a-8e17-4080919e65ad None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.735442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6fae-69b4-4f8a-8e17-4080919e65ad None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.735727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd6fae-69b4-4f8a-8e17-4080919e65ad None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.740906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 302/637] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:53.741690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6fae-69b4-4f8a-8e17-4080919e65ad None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:53.787091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 336/638] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:53.788196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd09c00-125e-4099-b6ca-4e6660dd1101 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:53.855946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd6fae-69b4-4f8a-8e17-4080919e65ad None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:53.893469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564efa3-ea5f-4735-ba56-c659c180cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:53.894065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564efa3-ea5f-4735-ba56-c659c180cc37 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.894345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564efa3-ea5f-4735-ba56-c659c180cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.894770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564efa3-ea5f-4735-ba56-c659c180cc37 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.895375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564efa3-ea5f-4735-ba56-c659c180cc37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:53.895695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564efa3-ea5f-4735-ba56-c659c180cc37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:53.897031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564efa3-ea5f-4735-ba56-c659c180cc37 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:53.897899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd09c00-125e-4099-b6ca-4e6660dd1101 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:53.905316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 303/639] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:53.906329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237277ff-b30e-4ef7-9dc5-8e9e91fea033 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.906615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237277ff-b30e-4ef7-9dc5-8e9e91fea033 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.906889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237277ff-b30e-4ef7-9dc5-8e9e91fea033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.914829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:53.922967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-237277ff-b30e-4ef7-9dc5-8e9e91fea033 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:53.924168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-237277ff-b30e-4ef7-9dc5-8e9e91fea033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:53.941842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf48b6-60ab-446b-8f97-161939167a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:53.942754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf48b6-60ab-446b-8f97-161939167a2c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:53.943238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf48b6-60ab-446b-8f97-161939167a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:53.943709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf48b6-60ab-446b-8f97-161939167a2c None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:53.944650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf48b6-60ab-446b-8f97-161939167a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:53.944968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf48b6-60ab-446b-8f97-161939167a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:53.946582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf48b6-60ab-446b-8f97-161939167a2c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:53.962919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 337/640] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:53.962919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf48b6-60ab-446b-8f97-161939167a2c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:53.978215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:53.999496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 304/641] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:54.004300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237277ff-b30e-4ef7-9dc5-8e9e91fea033 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.069170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf48b6-60ab-446b-8f97-161939167a2c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.105867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae9063-38f1-416c-bd42-5312c6a1629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.106762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae9063-38f1-416c-bd42-5312c6a1629e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.107167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae9063-38f1-416c-bd42-5312c6a1629e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.107478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae9063-38f1-416c-bd42-5312c6a1629e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.110072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237277ff-b30e-4ef7-9dc5-8e9e91fea033 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.118636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae9063-38f1-416c-bd42-5312c6a1629e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:54.120242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae9063-38f1-416c-bd42-5312c6a1629e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b9ae9063-38f1-416c-bd42-5312c6a1629e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:54.139708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:54.140639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:54.141529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:54.141529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:54.141529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:54.141529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:54.141529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 338/642] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:54.142431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae9063-38f1-416c-bd42-5312c6a1629e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.149740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49cdaa-76e0-456d-8cf4-3e9a4dcc1565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.150548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49cdaa-76e0-456d-8cf4-3e9a4dcc1565 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.150833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49cdaa-76e0-456d-8cf4-3e9a4dcc1565 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.151101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49cdaa-76e0-456d-8cf4-3e9a4dcc1565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.161694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49cdaa-76e0-456d-8cf4-3e9a4dcc1565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:54.163135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49cdaa-76e0-456d-8cf4-3e9a4dcc1565 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:54.169002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-df49cdaa-76e0-456d-8cf4-3e9a4dcc1565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:54.183390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:54.184422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:54.185335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:54.185335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:54.185335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:54.185335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:54.185335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 305/643] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:54.186214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49cdaa-76e0-456d-8cf4-3e9a4dcc1565 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.220911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:54.256538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae9063-38f1-416c-bd42-5312c6a1629e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.291269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b91b1-9887-4114-b77f-c29b35292f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.292109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b91b1-9887-4114-b77f-c29b35292f96 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.292397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b91b1-9887-4114-b77f-c29b35292f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.292676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b91b1-9887-4114-b77f-c29b35292f96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.292773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49cdaa-76e0-456d-8cf4-3e9a4dcc1565 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.301273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b91b1-9887-4114-b77f-c29b35292f96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:54.302759 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b91b1-9887-4114-b77f-c29b35292f96 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2d9b91b1-9887-4114-b77f-c29b35292f96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:54.317982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:54.318976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:54.320070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 339/644] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:54.320806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b91b1-9887-4114-b77f-c29b35292f96 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.336613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9db6c0-0122-4516-bbc4-dece85d835e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.337415 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9db6c0-0122-4516-bbc4-dece85d835e5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.337697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9db6c0-0122-4516-bbc4-dece85d835e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.337970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9db6c0-0122-4516-bbc4-dece85d835e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.350895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9db6c0-0122-4516-bbc4-dece85d835e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-bb9db6c0-0122-4516-bbc4-dece85d835e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:54.361377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:54.362343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:54.363184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 306/645] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:54.363937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9db6c0-0122-4516-bbc4-dece85d835e5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.415582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:54.434383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b91b1-9887-4114-b77f-c29b35292f96 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.465551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:54.470872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f50037-d82c-47e0-9e9f-fd97f8037c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.471549 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f50037-d82c-47e0-9e9f-fd97f8037c92 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.471831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f50037-d82c-47e0-9e9f-fd97f8037c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.472105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f50037-d82c-47e0-9e9f-fd97f8037c92 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.472825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f50037-d82c-47e0-9e9f-fd97f8037c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:54.473129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f50037-d82c-47e0-9e9f-fd97f8037c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:54.473894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9db6c0-0122-4516-bbc4-dece85d835e5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.474531 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f50037-d82c-47e0-9e9f-fd97f8037c92 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:54.495620 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 340/646] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:54.497904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f50037-d82c-47e0-9e9f-fd97f8037c92 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.518416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d9889-e813-4558-b54e-288b336bc1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.519078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d9889-e813-4558-b54e-288b336bc1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.519381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d9889-e813-4558-b54e-288b336bc1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.519662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d9889-e813-4558-b54e-288b336bc1e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.520384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d9889-e813-4558-b54e-288b336bc1e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:54.520905 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d9889-e813-4558-b54e-288b336bc1e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:54.522100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930d9889-e813-4558-b54e-288b336bc1e6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:54.535902 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 307/647] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:54.537191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d9889-e813-4558-b54e-288b336bc1e6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.605631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f50037-d82c-47e0-9e9f-fd97f8037c92 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.642107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7e8c3-9cc8-4e35-bf63-ddb86f5d9434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.642775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d9889-e813-4558-b54e-288b336bc1e6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.642908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7e8c3-9cc8-4e35-bf63-ddb86f5d9434 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.643154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7e8c3-9cc8-4e35-bf63-ddb86f5d9434 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.643469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7e8c3-9cc8-4e35-bf63-ddb86f5d9434 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.644322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7e8c3-9cc8-4e35-bf63-ddb86f5d9434 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:54.644642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7e8c3-9cc8-4e35-bf63-ddb86f5d9434 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:54.646073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7e8c3-9cc8-4e35-bf63-ddb86f5d9434 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:54.667019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 341/648] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:54.667959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7e8c3-9cc8-4e35-bf63-ddb86f5d9434 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.670730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:54.686016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00473335-1373-4ca5-842c-7c78b63f82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.686631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00473335-1373-4ca5-842c-7c78b63f82ee None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.686915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00473335-1373-4ca5-842c-7c78b63f82ee None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.687191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00473335-1373-4ca5-842c-7c78b63f82ee None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.687999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00473335-1373-4ca5-842c-7c78b63f82ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:54.688309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00473335-1373-4ca5-842c-7c78b63f82ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:54.689708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00473335-1373-4ca5-842c-7c78b63f82ee None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:54.702426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 308/649] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:54.702426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00473335-1373-4ca5-842c-7c78b63f82ee None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.719151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:54.778960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7e8c3-9cc8-4e35-bf63-ddb86f5d9434 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.802785 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00473335-1373-4ca5-842c-7c78b63f82ee None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.813939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7edb8c-a022-481d-aceb-f9763ba6e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.814729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7edb8c-a022-481d-aceb-f9763ba6e57f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.815007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7edb8c-a022-481d-aceb-f9763ba6e57f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.815273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7edb8c-a022-481d-aceb-f9763ba6e57f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.822070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7edb8c-a022-481d-aceb-f9763ba6e57f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:54.823543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7edb8c-a022-481d-aceb-f9763ba6e57f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:54.834517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1b930-b967-4daa-8056-048f6c1d4cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.835310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1b930-b967-4daa-8056-048f6c1d4cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.835617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1b930-b967-4daa-8056-048f6c1d4cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.835889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1b930-b967-4daa-8056-048f6c1d4cd1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-7b7edb8c-a022-481d-aceb-f9763ba6e57f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:54.837032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:54.838066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:54.838995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:54.838995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:54.838995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:54.838995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:54.838995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:54.838995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:54.838995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:54.838995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:54.838995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 342/650] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:54.839550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7edb8c-a022-481d-aceb-f9763ba6e57f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.848688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1b930-b967-4daa-8056-048f6c1d4cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:54.850118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1b930-b967-4daa-8056-048f6c1d4cd1 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-d9d1b930-b967-4daa-8056-048f6c1d4cd1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:54.864647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:54.865995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 309/651] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:54.866947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1b930-b967-4daa-8056-048f6c1d4cd1 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:54.903745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:54.942688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7edb8c-a022-481d-aceb-f9763ba6e57f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.943297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:54.966106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1b930-b967-4daa-8056-048f6c1d4cd1 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:54.976268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ff162-c130-40a5-926b-826554ddb7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.976912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff162-c130-40a5-926b-826554ddb7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:54.977195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff162-c130-40a5-926b-826554ddb7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:54.977473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff162-c130-40a5-926b-826554ddb7d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:54.999030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab6778-58e8-477d-9377-ba7316ee18d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:54.999837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab6778-58e8-477d-9377-ba7316ee18d9 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.000124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab6778-58e8-477d-9377-ba7316ee18d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.000396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab6778-58e8-477d-9377-ba7316ee18d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.010649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab6778-58e8-477d-9377-ba7316ee18d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.012116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab6778-58e8-477d-9377-ba7316ee18d9 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-19ab6778-58e8-477d-9377-ba7316ee18d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:55.029218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:55.030221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:55.031120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:55.031120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:55.031120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:55.031120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:55.031120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 310/652] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:55.031717 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003cfe0-c3a6-4856-84ad-c3f03c03759a None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.031931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003cfe0-c3a6-4856-84ad-c3f03c03759a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.032266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003cfe0-c3a6-4856-84ad-c3f03c03759a None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.034154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 311/653] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:55.034802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003cfe0-c3a6-4856-84ad-c3f03c03759a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.048706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ff162-c130-40a5-926b-826554ddb7d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.050140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ff162-c130-40a5-926b-826554ddb7d2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:55.108902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:55.135451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003cfe0-c3a6-4856-84ad-c3f03c03759a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:55.147726 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 343/654] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:55.148550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ff162-c130-40a5-926b-826554ddb7d2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.162622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:55.170828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44c158-3e93-4f16-bf74-9c9ccc267f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:55.171510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44c158-3e93-4f16-bf74-9c9ccc267f19 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.171791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44c158-3e93-4f16-bf74-9c9ccc267f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.172066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44c158-3e93-4f16-bf74-9c9ccc267f19 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.172853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44c158-3e93-4f16-bf74-9c9ccc267f19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:55.173161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44c158-3e93-4f16-bf74-9c9ccc267f19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.174644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44c158-3e93-4f16-bf74-9c9ccc267f19 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:55.186269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 312/655] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:55.187048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44c158-3e93-4f16-bf74-9c9ccc267f19 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.248473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ff162-c130-40a5-926b-826554ddb7d2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:55.281422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28a730-db22-410e-bad7-753a50dca776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:55.282087 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a730-db22-410e-bad7-753a50dca776 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.282924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a730-db22-410e-bad7-753a50dca776 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.283224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a730-db22-410e-bad7-753a50dca776 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.284087 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28a730-db22-410e-bad7-753a50dca776 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:55.284214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44c158-3e93-4f16-bf74-9c9ccc267f19 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:55.284394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28a730-db22-410e-bad7-753a50dca776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.285803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28a730-db22-410e-bad7-753a50dca776 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:55.302607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 344/656] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:55.303894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4413898-4a9f-43c7-bff5-4e4ea536b9ab None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.304180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4413898-4a9f-43c7-bff5-4e4ea536b9ab None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.304455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4413898-4a9f-43c7-bff5-4e4ea536b9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.317646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb19a2-2788-468a-9f56-5086db53cc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:55.318306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb19a2-2788-468a-9f56-5086db53cc42 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.318591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb19a2-2788-468a-9f56-5086db53cc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.318870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb19a2-2788-468a-9f56-5086db53cc42 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.319627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb19a2-2788-468a-9f56-5086db53cc42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:55.319934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb19a2-2788-468a-9f56-5086db53cc42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.320143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f4413898-4a9f-43c7-bff5-4e4ea536b9ab None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:55.321564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb19a2-2788-468a-9f56-5086db53cc42 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:55.321663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f4413898-4a9f-43c7-bff5-4e4ea536b9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:55.333377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 313/657] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:55.334160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb19a2-2788-468a-9f56-5086db53cc42 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.338048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:55.381879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:55.391706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 345/658] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:55.391706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4413898-4a9f-43c7-bff5-4e4ea536b9ab None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.442139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb19a2-2788-468a-9f56-5086db53cc42 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:55.475421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff823c-cd2f-4616-8d76-f1a3376562fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:55.476199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff823c-cd2f-4616-8d76-f1a3376562fa None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.476532 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff823c-cd2f-4616-8d76-f1a3376562fa None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.476806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff823c-cd2f-4616-8d76-f1a3376562fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.487012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff823c-cd2f-4616-8d76-f1a3376562fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.488488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff823c-cd2f-4616-8d76-f1a3376562fa None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:55.496862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4413898-4a9f-43c7-bff5-4e4ea536b9ab None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-9cff823c-cd2f-4616-8d76-f1a3376562fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:55.505986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:55.506849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:55.507828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:55.507828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:55.507828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:55.507828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:55.507828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 314/659] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:55.508112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff823c-cd2f-4616-8d76-f1a3376562fa None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.536197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb753b-0a16-4e74-8826-c8201519f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:55.536845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb753b-0a16-4e74-8826-c8201519f522 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.537127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb753b-0a16-4e74-8826-c8201519f522 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.537398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb753b-0a16-4e74-8826-c8201519f522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.538220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb753b-0a16-4e74-8826-c8201519f522 None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=dbba49c3d7c24cd699d85fb93c76e7fe) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:55.538530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb753b-0a16-4e74-8826-c8201519f522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.539976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb753b-0a16-4e74-8826-c8201519f522 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:55.545632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 346/660] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/role_assignments?user.id=dbba49c3d7c24cd699d85fb93c76e7fe&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:55.546402 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb753b-0a16-4e74-8826-c8201519f522 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.579795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:55.614976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:55.618588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff823c-cd2f-4616-8d76-f1a3376562fa None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:55.658001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d5035-1e95-432a-a122-c232322c565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:55.658673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d5035-1e95-432a-a122-c232322c565e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.658960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d5035-1e95-432a-a122-c232322c565e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.659243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d5035-1e95-432a-a122-c232322c565e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.680301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb753b-0a16-4e74-8826-c8201519f522 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:55.720345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25186-4c2f-4e33-97c2-79b3648e6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:55.721315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25186-4c2f-4e33-97c2-79b3648e6d02 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.721699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25186-4c2f-4e33-97c2-79b3648e6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.722593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f25186-4c2f-4e33-97c2-79b3648e6d02 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.733105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f25186-4c2f-4e33-97c2-79b3648e6d02 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.734852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f25186-4c2f-4e33-97c2-79b3648e6d02 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:55.738872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d5035-1e95-432a-a122-c232322c565e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.740158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d5035-1e95-432a-a122-c232322c565e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a1f25186-4c2f-4e33-97c2-79b3648e6d02 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:55.753764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:55.754749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 347/661] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:55.756151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25186-4c2f-4e33-97c2-79b3648e6d02 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.839444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:55.847896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:55.855984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 315/662] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:55.855984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d5035-1e95-432a-a122-c232322c565e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.880026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f25186-4c2f-4e33-97c2-79b3648e6d02 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:55.926046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cf794-d678-42c8-b53f-16e1a237e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:55.926860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf794-d678-42c8-b53f-16e1a237e199 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.927147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf794-d678-42c8-b53f-16e1a237e199 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.927455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cf794-d678-42c8-b53f-16e1a237e199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.941488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cf794-d678-42c8-b53f-16e1a237e199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-233cf794-d678-42c8-b53f-16e1a237e199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:08:55.952098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:55.953319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 348/663] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:55.954220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cf794-d678-42c8-b53f-16e1a237e199 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:55.960213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d5035-1e95-432a-a122-c232322c565e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:55.994715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8d8a-5a4c-4fab-9894-8ad67fc3a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:55.995403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8d8a-5a4c-4fab-9894-8ad67fc3a668 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:55.995689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8d8a-5a4c-4fab-9894-8ad67fc3a668 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:55.995964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f8d8a-5a4c-4fab-9894-8ad67fc3a668 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:55.996687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f8d8a-5a4c-4fab-9894-8ad67fc3a668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:55.996999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f8d8a-5a4c-4fab-9894-8ad67fc3a668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:55.998344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f8d8a-5a4c-4fab-9894-8ad67fc3a668 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.011663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 316/664] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:56.012790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8d8a-5a4c-4fab-9894-8ad67fc3a668 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.071445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cf794-d678-42c8-b53f-16e1a237e199 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.076137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:56.108886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5dddc-24a2-47be-b0ca-4ba011dc4610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.110158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5dddc-24a2-47be-b0ca-4ba011dc4610 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.111430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5dddc-24a2-47be-b0ca-4ba011dc4610 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.111891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5dddc-24a2-47be-b0ca-4ba011dc4610 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:56.113469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5dddc-24a2-47be-b0ca-4ba011dc4610 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:56.113966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5dddc-24a2-47be-b0ca-4ba011dc4610 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:56.116322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5dddc-24a2-47be-b0ca-4ba011dc4610 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.118822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:56.120771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f8d8a-5a4c-4fab-9894-8ad67fc3a668 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.139665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 349/665] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Jun 7 14:08:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:56.141258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5dddc-24a2-47be-b0ca-4ba011dc4610 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.154971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9dacd-8b48-4b60-81ce-914967983fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.156151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9dacd-8b48-4b60-81ce-914967983fed None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.156439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9dacd-8b48-4b60-81ce-914967983fed None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.157535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9dacd-8b48-4b60-81ce-914967983fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:56.168860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9dacd-8b48-4b60-81ce-914967983fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:56.170516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9dacd-8b48-4b60-81ce-914967983fed None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-3dd9dacd-8b48-4b60-81ce-914967983fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:56.191273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:56.192252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:56.193177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:56.193177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:56.193177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:56.193177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:56.193177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 317/666] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:56.193790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9dacd-8b48-4b60-81ce-914967983fed None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.256239 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5dddc-24a2-47be-b0ca-4ba011dc4610 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.295861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3d645-ad10-4de2-bec7-b6fb6aa8f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.296442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3d645-ad10-4de2-bec7-b6fb6aa8f19f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.296716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3d645-ad10-4de2-bec7-b6fb6aa8f19f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.296988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3d645-ad10-4de2-bec7-b6fb6aa8f19f None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:56.298353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3d645-ad10-4de2-bec7-b6fb6aa8f19f None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:56.298662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3d645-ad10-4de2-bec7-b6fb6aa8f19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:56.300166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3d645-ad10-4de2-bec7-b6fb6aa8f19f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.306015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9dacd-8b48-4b60-81ce-914967983fed None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.312363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 350/667] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:56.312363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3d645-ad10-4de2-bec7-b6fb6aa8f19f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.325142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:56.348601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635be27-482b-4bb0-8feb-8190cff182ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.349402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635be27-482b-4bb0-8feb-8190cff182ca None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.349686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635be27-482b-4bb0-8feb-8190cff182ca None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.349959 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635be27-482b-4bb0-8feb-8190cff182ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:56.357054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635be27-482b-4bb0-8feb-8190cff182ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:56.358500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635be27-482b-4bb0-8feb-8190cff182ca None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.370971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-0635be27-482b-4bb0-8feb-8190cff182ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:56.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:56.374969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 318/668] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:56.380798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635be27-482b-4bb0-8feb-8190cff182ca None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.428908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3d645-ad10-4de2-bec7-b6fb6aa8f19f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.466659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6d2bd-fe7b-4a8e-918c-a5100c724774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.467631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6d2bd-fe7b-4a8e-918c-a5100c724774 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.468106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6d2bd-fe7b-4a8e-918c-a5100c724774 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.468460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6d2bd-fe7b-4a8e-918c-a5100c724774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:56.494725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635be27-482b-4bb0-8feb-8190cff182ca None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.535690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8934d1f-2863-4332-a5bd-095073ca1927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.536346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8934d1f-2863-4332-a5bd-095073ca1927 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.536625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8934d1f-2863-4332-a5bd-095073ca1927 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.536894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8934d1f-2863-4332-a5bd-095073ca1927 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:56.537619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8934d1f-2863-4332-a5bd-095073ca1927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:56.537916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8934d1f-2863-4332-a5bd-095073ca1927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:56.539270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8934d1f-2863-4332-a5bd-095073ca1927 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.550065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6d2bd-fe7b-4a8e-918c-a5100c724774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:56.550908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 319/669] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:56.551724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8934d1f-2863-4332-a5bd-095073ca1927 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.552211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6d2bd-fe7b-4a8e-918c-a5100c724774 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.584953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:56.622020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:56.657802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8934d1f-2863-4332-a5bd-095073ca1927 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.673883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 351/670] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:08:56.673883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6d2bd-fe7b-4a8e-918c-a5100c724774 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.692552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba717f10-2698-4684-9862-ffe482baeba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.693464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717f10-2698-4684-9862-ffe482baeba5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.693841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717f10-2698-4684-9862-ffe482baeba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.694191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba717f10-2698-4684-9862-ffe482baeba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:56.706942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba717f10-2698-4684-9862-ffe482baeba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:56.708576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba717f10-2698-4684-9862-ffe482baeba5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-ba717f10-2698-4684-9862-ffe482baeba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:56.728049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:56.729177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:56.730261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:56.730261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:56.730261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:56.730261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:56.735923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 320/671] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:56.735923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba717f10-2698-4684-9862-ffe482baeba5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.787164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6d2bd-fe7b-4a8e-918c-a5100c724774 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.824642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8db90-7fc9-4422-a6c1-9cab2ae9d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.825223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8db90-7fc9-4422-a6c1-9cab2ae9d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.825355 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:56.825499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8db90-7fc9-4422-a6c1-9cab2ae9d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.826055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8db90-7fc9-4422-a6c1-9cab2ae9d1d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:56.826554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8db90-7fc9-4422-a6c1-9cab2ae9d1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:56.826846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8db90-7fc9-4422-a6c1-9cab2ae9d1d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:56.828385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8db90-7fc9-4422-a6c1-9cab2ae9d1d0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.840824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 352/672] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:56.841657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8db90-7fc9-4422-a6c1-9cab2ae9d1d0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.849651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba717f10-2698-4684-9862-ffe482baeba5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.859850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:56.890780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35d420-dc4e-4b4c-9d74-f1d0fa7c5deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.892192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35d420-dc4e-4b4c-9d74-f1d0fa7c5deb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.892483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35d420-dc4e-4b4c-9d74-f1d0fa7c5deb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.892754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35d420-dc4e-4b4c-9d74-f1d0fa7c5deb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:56.900924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35d420-dc4e-4b4c-9d74-f1d0fa7c5deb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:56.902360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35d420-dc4e-4b4c-9d74-f1d0fa7c5deb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-6d35d420-dc4e-4b4c-9d74-f1d0fa7c5deb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:56.916383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:56.917291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:56.918180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:56.918180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:56.918180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:56.918180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:56.918180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:56.918180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:56.918180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:56.918180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:56.922211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 321/673] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:56.923083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35d420-dc4e-4b4c-9d74-f1d0fa7c5deb None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:56.955504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8db90-7fc9-4422-a6c1-9cab2ae9d1d0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:56.993151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d0589-ea53-413d-b651-2b606b2c4c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:56.993947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d0589-ea53-413d-b651-2b606b2c4c2b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:56.994228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d0589-ea53-413d-b651-2b606b2c4c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:56.994501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d0589-ea53-413d-b651-2b606b2c4c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.005385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d0589-ea53-413d-b651-2b606b2c4c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.006790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d0589-ea53-413d-b651-2b606b2c4c2b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-195d0589-ea53-413d-b651-2b606b2c4c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:57.024436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:57.025318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:57.030914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:57.030914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:57.030914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:57.030914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:57.031138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35d420-dc4e-4b4c-9d74-f1d0fa7c5deb None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:57.031574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 353/674] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:57.031574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d0589-ea53-413d-b651-2b606b2c4c2b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:57.068652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c0320-ec53-4168-a5dd-565350a67cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:57.069318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c0320-ec53-4168-a5dd-565350a67cdd None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:57.069598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c0320-ec53-4168-a5dd-565350a67cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:57.069874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c0320-ec53-4168-a5dd-565350a67cdd None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.070622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c0320-ec53-4168-a5dd-565350a67cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:57.070926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c0320-ec53-4168-a5dd-565350a67cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.072984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c0320-ec53-4168-a5dd-565350a67cdd None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.085265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 322/675] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:57.088496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c0320-ec53-4168-a5dd-565350a67cdd None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:57.092925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:57.100045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:57.140874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d0589-ea53-413d-b651-2b606b2c4c2b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:57.176444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31625f3d-177c-4b8a-9f53-0335ecf041a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:57.177101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31625f3d-177c-4b8a-9f53-0335ecf041a2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:57.177384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31625f3d-177c-4b8a-9f53-0335ecf041a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:57.177662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31625f3d-177c-4b8a-9f53-0335ecf041a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.178547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31625f3d-177c-4b8a-9f53-0335ecf041a2 None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=e1ea02cd5e644aaba236acf4e46cb20f) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:57.178864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31625f3d-177c-4b8a-9f53-0335ecf041a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.180331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31625f3d-177c-4b8a-9f53-0335ecf041a2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.186363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 354/676] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:57 2022] GET /identity/v3/role_assignments?user.id=e1ea02cd5e644aaba236acf4e46cb20f&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:57.187037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31625f3d-177c-4b8a-9f53-0335ecf041a2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:57.195168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c0320-ec53-4168-a5dd-565350a67cdd None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:57.249862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40265bc-1a0b-4214-946c-0c55d257b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:57.251234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40265bc-1a0b-4214-946c-0c55d257b6bf None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:57.252066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40265bc-1a0b-4214-946c-0c55d257b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:57.252585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40265bc-1a0b-4214-946c-0c55d257b6bf None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.254620 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40265bc-1a0b-4214-946c-0c55d257b6bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:57.255205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40265bc-1a0b-4214-946c-0c55d257b6bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.258268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40265bc-1a0b-4214-946c-0c55d257b6bf None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.278026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 323/677] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:57.279755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40265bc-1a0b-4214-946c-0c55d257b6bf None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:57.306231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31625f3d-177c-4b8a-9f53-0335ecf041a2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:57.338555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:57.346139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3af71f-468e-4c06-ae9c-6e40253c5ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:57.347367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3af71f-468e-4c06-ae9c-6e40253c5ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:57.347367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3af71f-468e-4c06-ae9c-6e40253c5ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:57.347367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3af71f-468e-4c06-ae9c-6e40253c5ba6 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.348138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3af71f-468e-4c06-ae9c-6e40253c5ba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:57.348447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3af71f-468e-4c06-ae9c-6e40253c5ba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.349859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3af71f-468e-4c06-ae9c-6e40253c5ba6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.359411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:57.368448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 355/678] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:57.368448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3af71f-468e-4c06-ae9c-6e40253c5ba6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:57.420716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40265bc-1a0b-4214-946c-0c55d257b6bf None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:57.466295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0782cfe-f2fc-4cfe-bf92-3d4968cf3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:57.466295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782cfe-f2fc-4cfe-bf92-3d4968cf3a96 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:57.466592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782cfe-f2fc-4cfe-bf92-3d4968cf3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:57.466592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0782cfe-f2fc-4cfe-bf92-3d4968cf3a96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.476307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0782cfe-f2fc-4cfe-bf92-3d4968cf3a96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.478759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0782cfe-f2fc-4cfe-bf92-3d4968cf3a96 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-d0782cfe-f2fc-4cfe-bf92-3d4968cf3a96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:08:57.499076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:57.500015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:08:57.500989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:57.501531 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3af71f-468e-4c06-ae9c-6e40253c5ba6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:57.503325 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 324/679] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:08:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:57.504300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0782cfe-f2fc-4cfe-bf92-3d4968cf3a96 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:57.550538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08f1f0-efb2-48e3-aac5-862bd6e5d17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:57.551221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08f1f0-efb2-48e3-aac5-862bd6e5d17b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:57.551551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08f1f0-efb2-48e3-aac5-862bd6e5d17b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:57.551831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08f1f0-efb2-48e3-aac5-862bd6e5d17b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.553392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08f1f0-efb2-48e3-aac5-862bd6e5d17b None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=a418c5817e784d299c8d6daad20c6cdb) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:57.553710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08f1f0-efb2-48e3-aac5-862bd6e5d17b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.555197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08f1f0-efb2-48e3-aac5-862bd6e5d17b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.570260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 356/680] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:57 2022] GET /identity/v3/role_assignments?user.id=a418c5817e784d299c8d6daad20c6cdb&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:57.570260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08f1f0-efb2-48e3-aac5-862bd6e5d17b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:57.670488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0782cfe-f2fc-4cfe-bf92-3d4968cf3a96 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:57.675997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:57.720066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:57.741456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c82153-1550-4a12-a6f4-93304c63b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:57.742273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82153-1550-4a12-a6f4-93304c63b87a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:57.742554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82153-1550-4a12-a6f4-93304c63b87a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:57.742827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82153-1550-4a12-a6f4-93304c63b87a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.755838 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c82153-1550-4a12-a6f4-93304c63b87a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.757350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c82153-1550-4a12-a6f4-93304c63b87a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.768956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08f1f0-efb2-48e3-aac5-862bd6e5d17b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-b4c82153-1550-4a12-a6f4-93304c63b87a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:57.779594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:57.780814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:57.782436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:57.782436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:57.782436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:57.782436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:57.782436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:57.782436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:57.782436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:57.782436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:57.782436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 325/681] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:57.792594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c82153-1550-4a12-a6f4-93304c63b87a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:57.821728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e79b4-818f-4777-b7b7-ab79d9a3f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:57.822664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e79b4-818f-4777-b7b7-ab79d9a3f777 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:57.823046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e79b4-818f-4777-b7b7-ab79d9a3f777 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:57.823454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e79b4-818f-4777-b7b7-ab79d9a3f777 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.824586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e79b4-818f-4777-b7b7-ab79d9a3f777 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:57.824997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e79b4-818f-4777-b7b7-ab79d9a3f777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.826938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e79b4-818f-4777-b7b7-ab79d9a3f777 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.855142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 357/682] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jun 7 14:08:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:57.856532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e79b4-818f-4777-b7b7-ab79d9a3f777 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:57.933935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c82153-1550-4a12-a6f4-93304c63b87a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:57.980431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb735-bd5c-4b4a-b642-81b20c7bded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:57.980431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb735-bd5c-4b4a-b642-81b20c7bded8 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:57.980431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb735-bd5c-4b4a-b642-81b20c7bded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:57.980821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb735-bd5c-4b4a-b642-81b20c7bded8 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:57.981970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb735-bd5c-4b4a-b642-81b20c7bded8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:57.981970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb735-bd5c-4b4a-b642-81b20c7bded8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:57.983962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb735-bd5c-4b4a-b642-81b20c7bded8 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:57.994098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e79b4-818f-4777-b7b7-ab79d9a3f777 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:58.000367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 326/683] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:58.001732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ecaa2-4502-4880-a4bb-1a523b38eaba None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:58.002430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ecaa2-4502-4880-a4bb-1a523b38eaba None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:58.002727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ecaa2-4502-4880-a4bb-1a523b38eaba None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:58.004210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 327/684] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:58.006881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ecaa2-4502-4880-a4bb-1a523b38eaba None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:58.009594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:58.039731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4a05e-5976-4e27-ac1e-f878aa553c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:58.040530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4a05e-5976-4e27-ac1e-f878aa553c2e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:58.040914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4a05e-5976-4e27-ac1e-f878aa553c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:58.041289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4a05e-5976-4e27-ac1e-f878aa553c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:58.070035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:58.125385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4a05e-5976-4e27-ac1e-f878aa553c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:58.127605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4a05e-5976-4e27-ac1e-f878aa553c2e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:58.137473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ecaa2-4502-4880-a4bb-1a523b38eaba None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:58.175706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbd29a-839a-46d7-8834-2b909b1f67d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:58.176619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd29a-839a-46d7-8834-2b909b1f67d6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:58.177074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd29a-839a-46d7-8834-2b909b1f67d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:58.177498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd29a-839a-46d7-8834-2b909b1f67d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:58.178547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbd29a-839a-46d7-8834-2b909b1f67d6 None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=fafd295a115c4f5d912e49d6a21d67b3) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:58.178993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbd29a-839a-46d7-8834-2b909b1f67d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:58.180714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbd29a-839a-46d7-8834-2b909b1f67d6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:58.188097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 328/685] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:58 2022] GET /identity/v3/role_assignments?user.id=fafd295a115c4f5d912e49d6a21d67b3&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:58.189589 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c0e5-6d3e-4324-8eef-e9d813c8ffcf None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:58.190030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c0e5-6d3e-4324-8eef-e9d813c8ffcf None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:58.190417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c0e5-6d3e-4324-8eef-e9d813c8ffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:58.209757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4d12c0e5-6d3e-4324-8eef-e9d813c8ffcf None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:58.211263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4d12c0e5-6d3e-4324-8eef-e9d813c8ffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:08:58.292099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 358/686] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:08:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 07 14:08:58.294352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4a05e-5976-4e27-ac1e-f878aa553c2e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:58.333079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:58.416791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 329/687] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:08:58.444011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4a05e-5976-4e27-ac1e-f878aa553c2e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:58.456309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12c0e5-6d3e-4324-8eef-e9d813c8ffcf None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:58.486659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296b1f5-879b-437f-99d4-e797db08251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:58.488198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296b1f5-879b-437f-99d4-e797db08251d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:58.488685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296b1f5-879b-437f-99d4-e797db08251d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:58.489158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296b1f5-879b-437f-99d4-e797db08251d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:58.502350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296b1f5-879b-437f-99d4-e797db08251d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:58.504443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296b1f5-879b-437f-99d4-e797db08251d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:58.516519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-0296b1f5-879b-437f-99d4-e797db08251d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:08:58.533140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:58.534242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:58.535308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:08:58.535308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:08:58.535308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:08:58.535308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:58.535308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 359/688] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:58.541483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296b1f5-879b-437f-99d4-e797db08251d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:58.608787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12c0e5-6d3e-4324-8eef-e9d813c8ffcf None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:58.626062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:58.649006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc2e6e-fe20-4a29-a8af-f5c9b3b802bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:58.649835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc2e6e-fe20-4a29-a8af-f5c9b3b802bb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:58.650119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc2e6e-fe20-4a29-a8af-f5c9b3b802bb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:58.650396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc2e6e-fe20-4a29-a8af-f5c9b3b802bb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:58.651063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc2e6e-fe20-4a29-a8af-f5c9b3b802bb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:58.652481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc2e6e-fe20-4a29-a8af-f5c9b3b802bb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-11dc2e6e-fe20-4a29-a8af-f5c9b3b802bb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:58.668347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:58.669397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:08:58.670233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:08:58.674307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 330/689] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Jun 7 14:08:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:08:58.676585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc2e6e-fe20-4a29-a8af-f5c9b3b802bb None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:58.681194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296b1f5-879b-437f-99d4-e797db08251d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:58.717743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3cde-394c-4c8c-af2c-85fa7507c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:58.718329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3cde-394c-4c8c-af2c-85fa7507c991 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:58.718612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3cde-394c-4c8c-af2c-85fa7507c991 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:58.718888 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc3cde-394c-4c8c-af2c-85fa7507c991 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:58.719709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc3cde-394c-4c8c-af2c-85fa7507c991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:58.720020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc3cde-394c-4c8c-af2c-85fa7507c991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:58.721391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc3cde-394c-4c8c-af2c-85fa7507c991 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:58.733635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 360/690] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:58.740119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3cde-394c-4c8c-af2c-85fa7507c991 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:58.829965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc2e6e-fe20-4a29-a8af-f5c9b3b802bb None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:58.832061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:58.870521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc3cde-394c-4c8c-af2c-85fa7507c991 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:58.896702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:58.914106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33884b-f8f0-425b-9d05-8950d959abe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:58.917083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33884b-f8f0-425b-9d05-8950d959abe2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:58.917365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33884b-f8f0-425b-9d05-8950d959abe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:58.917639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33884b-f8f0-425b-9d05-8950d959abe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:58.925718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ec2a8-72b2-4f91-a1ee-67bf33be49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:58.926364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ec2a8-72b2-4f91-a1ee-67bf33be49d9 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:58.926647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ec2a8-72b2-4f91-a1ee-67bf33be49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:58.926921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ec2a8-72b2-4f91-a1ee-67bf33be49d9 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:58.927669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ec2a8-72b2-4f91-a1ee-67bf33be49d9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:58.927973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ec2a8-72b2-4f91-a1ee-67bf33be49d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:58.929357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5ec2a8-72b2-4f91-a1ee-67bf33be49d9 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:58.936733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33884b-f8f0-425b-9d05-8950d959abe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:58.938193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33884b-f8f0-425b-9d05-8950d959abe2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:58.941824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 331/691] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jun 7 14:08:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:08:58.947604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ec2a8-72b2-4f91-a1ee-67bf33be49d9 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-7c33884b-f8f0-425b-9d05-8950d959abe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:08:58.960559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:08:58.961460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:08:58.962358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:08:58.962358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:08:58.962358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:08:58.962358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:08:58.962358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:08:58.962358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:08:58.962358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:08:58.962358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:08:58.962358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 361/692] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:08:58.978631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33884b-f8f0-425b-9d05-8950d959abe2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:59.119313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ec2a8-72b2-4f91-a1ee-67bf33be49d9 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:59.180032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d219d66-7720-4d6d-bc20-da0adf8a65bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:59.180840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d219d66-7720-4d6d-bc20-da0adf8a65bb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:59.181126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d219d66-7720-4d6d-bc20-da0adf8a65bb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:59.184526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d219d66-7720-4d6d-bc20-da0adf8a65bb None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:59.185265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d219d66-7720-4d6d-bc20-da0adf8a65bb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:59.185579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d219d66-7720-4d6d-bc20-da0adf8a65bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:59.186950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d219d66-7720-4d6d-bc20-da0adf8a65bb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:59.197769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33884b-f8f0-425b-9d05-8950d959abe2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:59.203204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 332/693] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jun 7 14:08:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:59.240767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c81db-41e1-48c3-9d96-05eee028c5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:59.241357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c81db-41e1-48c3-9d96-05eee028c5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:59.241641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c81db-41e1-48c3-9d96-05eee028c5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:59.241922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c81db-41e1-48c3-9d96-05eee028c5e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:59.242748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c81db-41e1-48c3-9d96-05eee028c5e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:59.243044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c81db-41e1-48c3-9d96-05eee028c5e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:59.244549 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c81db-41e1-48c3-9d96-05eee028c5e2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:59.258711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 362/694] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:59.264875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d219d66-7720-4d6d-bc20-da0adf8a65bb None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:08:59.327954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:08:59.432814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d219d66-7720-4d6d-bc20-da0adf8a65bb None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:08:59.485813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3a810-5b3e-4f7c-bc54-450a88c6c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:08:59.486497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a810-5b3e-4f7c-bc54-450a88c6c985 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:59.486782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a810-5b3e-4f7c-bc54-450a88c6c985 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:59.487056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a810-5b3e-4f7c-bc54-450a88c6c985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:59.487936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3a810-5b3e-4f7c-bc54-450a88c6c985 None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=ee8475d17d2349559125d2bcd969b9f5) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:08:59.488247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3a810-5b3e-4f7c-bc54-450a88c6c985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:08:59.494501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3a810-5b3e-4f7c-bc54-450a88c6c985 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:08:59.501539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 333/695] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:08:59 2022] GET /identity/v3/role_assignments?user.id=ee8475d17d2349559125d2bcd969b9f5&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:08:59.943131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421230fa-6410-4ee5-8dcb-a26a568534b0 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:59.943676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421230fa-6410-4ee5-8dcb-a26a568534b0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:59.943780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421230fa-6410-4ee5-8dcb-a26a568534b0 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:59.945210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 363/696] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:08:59.951038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e323e57-6a82-4a7d-a9c3-0917d9777ee6 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:08:59.951639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e323e57-6a82-4a7d-a9c3-0917d9777ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:08:59.952124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e323e57-6a82-4a7d-a9c3-0917d9777ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:08:59.972434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6e323e57-6a82-4a7d-a9c3-0917d9777ee6 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:08:59.974024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6e323e57-6a82-4a7d-a9c3-0917d9777ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:00.047925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 334/697] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:09:00.072398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421230fa-6410-4ee5-8dcb-a26a568534b0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:00.124048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:00.184670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421230fa-6410-4ee5-8dcb-a26a568534b0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:00.221796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d377ac3-b8a4-4244-954e-42b86c7db6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:00.222921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377ac3-b8a4-4244-954e-42b86c7db6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:00.223463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377ac3-b8a4-4244-954e-42b86c7db6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:00.224100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d377ac3-b8a4-4244-954e-42b86c7db6a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:00.248453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d377ac3-b8a4-4244-954e-42b86c7db6a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2d377ac3-b8a4-4244-954e-42b86c7db6a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:00.261196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:00.262147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:00.262986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:00.266829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 364/698] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:00.272952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e323e57-6a82-4a7d-a9c3-0917d9777ee6 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:00.301721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:00.337574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425de79-b16f-4422-9e84-c806aa935c9e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:00.337925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425de79-b16f-4422-9e84-c806aa935c9e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:00.338137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425de79-b16f-4422-9e84-c806aa935c9e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:00.339780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 365/699] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:00.346688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b859e-e0bb-459a-aef9-5b6c00ef1cbd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:00.347250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b859e-e0bb-459a-aef9-5b6c00ef1cbd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:00.347814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b859e-e0bb-459a-aef9-5b6c00ef1cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:00.367327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-015b859e-e0bb-459a-aef9-5b6c00ef1cbd None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:00.368963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-015b859e-e0bb-459a-aef9-5b6c00ef1cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:00.394350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e323e57-6a82-4a7d-a9c3-0917d9777ee6 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:00.442442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 366/700] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 07 14:09:00.447381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f973b4-c8b8-4c1d-be0c-fb02150194b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:00.447381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f973b4-c8b8-4c1d-be0c-fb02150194b2 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:00.447381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f973b4-c8b8-4c1d-be0c-fb02150194b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:00.447381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f973b4-c8b8-4c1d-be0c-fb02150194b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:00.447711 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f973b4-c8b8-4c1d-be0c-fb02150194b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:00.447711 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f973b4-c8b8-4c1d-be0c-fb02150194b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:00.448319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f973b4-c8b8-4c1d-be0c-fb02150194b2 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:00.462852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 335/701] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:00.468316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b859e-e0bb-459a-aef9-5b6c00ef1cbd None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:00.477612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f973b4-c8b8-4c1d-be0c-fb02150194b2 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:00.507713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:00.580268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b859e-e0bb-459a-aef9-5b6c00ef1cbd None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:00.583621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:00.613282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f973b4-c8b8-4c1d-be0c-fb02150194b2 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:00.622804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afad21-17ed-422c-9b5c-f2afdfc0e589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:00.623915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afad21-17ed-422c-9b5c-f2afdfc0e589 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:00.624556 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afad21-17ed-422c-9b5c-f2afdfc0e589 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:00.624765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afad21-17ed-422c-9b5c-f2afdfc0e589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:00.636963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afad21-17ed-422c-9b5c-f2afdfc0e589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:00.638654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afad21-17ed-422c-9b5c-f2afdfc0e589 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-93afad21-17ed-422c-9b5c-f2afdfc0e589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:00.658870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:00.659985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:00.661113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:00.661113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:00.661113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:00.661113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:00.662720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 367/702] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:00.664125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e46ee-f694-45ea-a2a5-e04fb04d9604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:00.665097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e46ee-f694-45ea-a2a5-e04fb04d9604 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:00.665512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e46ee-f694-45ea-a2a5-e04fb04d9604 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:00.665918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e46ee-f694-45ea-a2a5-e04fb04d9604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:00.670081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afad21-17ed-422c-9b5c-f2afdfc0e589 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:00.690742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e46ee-f694-45ea-a2a5-e04fb04d9604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:00.692252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e46ee-f694-45ea-a2a5-e04fb04d9604 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-b82e46ee-f694-45ea-a2a5-e04fb04d9604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:00.727897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:00.728807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:00.729772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:00.729772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:00.729772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:00.729772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:00.734140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 336/703] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:00.759610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e46ee-f694-45ea-a2a5-e04fb04d9604 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:00.833632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:00.864521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afad21-17ed-422c-9b5c-f2afdfc0e589 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:00.935834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dca946-af26-4fce-bbde-87bfd5d71793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:00.936503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dca946-af26-4fce-bbde-87bfd5d71793 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:00.936786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dca946-af26-4fce-bbde-87bfd5d71793 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:00.937062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dca946-af26-4fce-bbde-87bfd5d71793 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:00.937803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dca946-af26-4fce-bbde-87bfd5d71793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:00.938679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dca946-af26-4fce-bbde-87bfd5d71793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:00.940115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dca946-af26-4fce-bbde-87bfd5d71793 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:00.952081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e46ee-f694-45ea-a2a5-e04fb04d9604 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:00.952978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 368/704] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:00.954333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e02ca-09f2-43e6-9110-a8f4df2a7ab2 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:00.954644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e02ca-09f2-43e6-9110-a8f4df2a7ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:00.954913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e02ca-09f2-43e6-9110-a8f4df2a7ab2 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:00.964755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 369/705] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:00.964755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e02ca-09f2-43e6-9110-a8f4df2a7ab2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:01.001176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12827119-dd6f-407b-8880-07ef5f25eb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:01.001780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827119-dd6f-407b-8880-07ef5f25eb07 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:01.002080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827119-dd6f-407b-8880-07ef5f25eb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:01.002430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827119-dd6f-407b-8880-07ef5f25eb07 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:01.003171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12827119-dd6f-407b-8880-07ef5f25eb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:01.003518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12827119-dd6f-407b-8880-07ef5f25eb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:01.004974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12827119-dd6f-407b-8880-07ef5f25eb07 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:01.013845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:01.020491 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 337/706] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:01.023271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc895b81-57ea-4ecd-9f35-e7f349551e77 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:01.023966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc895b81-57ea-4ecd-9f35-e7f349551e77 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:01.024582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc895b81-57ea-4ecd-9f35-e7f349551e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:01.044727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-cc895b81-57ea-4ecd-9f35-e7f349551e77 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:01.046217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-cc895b81-57ea-4ecd-9f35-e7f349551e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:01.087546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e02ca-09f2-43e6-9110-a8f4df2a7ab2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:01.118651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 338/707] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:09:01.119524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc895b81-57ea-4ecd-9f35-e7f349551e77 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:01.123127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dafa18-ae1b-4158-bdfe-b2b0ef3e0d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:01.124104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dafa18-ae1b-4158-bdfe-b2b0ef3e0d34 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:01.124534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dafa18-ae1b-4158-bdfe-b2b0ef3e0d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:01.124916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dafa18-ae1b-4158-bdfe-b2b0ef3e0d34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:01.133865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dafa18-ae1b-4158-bdfe-b2b0ef3e0d34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:01.135477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dafa18-ae1b-4158-bdfe-b2b0ef3e0d34 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-98dafa18-ae1b-4158-bdfe-b2b0ef3e0d34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:01.150941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:01.152054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:01.153235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 370/708] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jun 7 14:09:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:01.159136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dafa18-ae1b-4158-bdfe-b2b0ef3e0d34 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:01.169445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:01.225424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc895b81-57ea-4ecd-9f35-e7f349551e77 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:01.254436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:01.265218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50432-ce28-428f-a405-93f5d3608058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:01.265925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50432-ce28-428f-a405-93f5d3608058 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:01.266222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50432-ce28-428f-a405-93f5d3608058 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:01.266623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50432-ce28-428f-a405-93f5d3608058 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:01.267528 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a50432-ce28-428f-a405-93f5d3608058 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:01.269621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a50432-ce28-428f-a405-93f5d3608058 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:01.272305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dafa18-ae1b-4158-bdfe-b2b0ef3e0d34 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:01.307677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 339/709] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:09:01 2022] POST /identity/v3/users => generated 254 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:01.309436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50432-ce28-428f-a405-93f5d3608058 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:01.337032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990ce7-5a2c-47b7-bf13-8bc80f570312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:01.338416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990ce7-5a2c-47b7-bf13-8bc80f570312 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:01.338920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990ce7-5a2c-47b7-bf13-8bc80f570312 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:01.339442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d990ce7-5a2c-47b7-bf13-8bc80f570312 None admin] PATH_INFO: `/v3/services/network` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:01.340453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d990ce7-5a2c-47b7-bf13-8bc80f570312 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:01.342448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d990ce7-5a2c-47b7-bf13-8bc80f570312 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8d990ce7-5a2c-47b7-bf13-8bc80f570312 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:01.367967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:01.369090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:09:01.369967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:01.378288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 371/710] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:01 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:01.382873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990ce7-5a2c-47b7-bf13-8bc80f570312 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:01.521285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50432-ce28-428f-a405-93f5d3608058 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:01.565472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118a23a-8ca9-4ec6-867f-56d732615d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:01.565945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:01.568954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118a23a-8ca9-4ec6-867f-56d732615d3c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:01.569493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118a23a-8ca9-4ec6-867f-56d732615d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:01.569982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118a23a-8ca9-4ec6-867f-56d732615d3c None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:01.571325 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118a23a-8ca9-4ec6-867f-56d732615d3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:01.571920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118a23a-8ca9-4ec6-867f-56d732615d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:01.573628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118a23a-8ca9-4ec6-867f-56d732615d3c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:01.601787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 340/711] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jun 7 14:09:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:01.607784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118a23a-8ca9-4ec6-867f-56d732615d3c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:01.618549 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d990ce7-5a2c-47b7-bf13-8bc80f570312 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:01.666617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b2690-6495-4374-bef1-deb30692b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:01.667379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2690-6495-4374-bef1-deb30692b239 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:01.669421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2690-6495-4374-bef1-deb30692b239 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:01.669706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2690-6495-4374-bef1-deb30692b239 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:01.670485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b2690-6495-4374-bef1-deb30692b239 None admin] RBAC: Adding query filter params (name=network) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:01.670800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b2690-6495-4374-bef1-deb30692b239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:01.673760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b2690-6495-4374-bef1-deb30692b239 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:01.676310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:01.684131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 372/712] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:01.688980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b2690-6495-4374-bef1-deb30692b239 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:01.767572 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118a23a-8ca9-4ec6-867f-56d732615d3c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:01.815374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103c92-cd2d-4e80-a6c7-ab238e67755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:01.816601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103c92-cd2d-4e80-a6c7-ab238e67755d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:01.817261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103c92-cd2d-4e80-a6c7-ab238e67755d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:01.817720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23103c92-cd2d-4e80-a6c7-ab238e67755d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:01.821094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b2690-6495-4374-bef1-deb30692b239 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:01.889746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19148b25-7386-467d-9cf5-e7b9269fbac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:01.890415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19148b25-7386-467d-9cf5-e7b9269fbac7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:01.890697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19148b25-7386-467d-9cf5-e7b9269fbac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:01.891544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19148b25-7386-467d-9cf5-e7b9269fbac7 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:01.892262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19148b25-7386-467d-9cf5-e7b9269fbac7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:01.892569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19148b25-7386-467d-9cf5-e7b9269fbac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:01.893919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19148b25-7386-467d-9cf5-e7b9269fbac7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:01.897279 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:01.907755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 373/713] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:01.936754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23103c92-cd2d-4e80-a6c7-ab238e67755d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:01.938300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23103c92-cd2d-4e80-a6c7-ab238e67755d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:02.029294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:02.072828 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63482021-7778-407e-8414-8adb432a1563 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:02.073327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63482021-7778-407e-8414-8adb432a1563 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:02.073327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63482021-7778-407e-8414-8adb432a1563 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:02.075806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 374/714] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:02.084863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7581-1de2-497d-80e6-7e4bf06d0c14 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:02.085163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7581-1de2-497d-80e6-7e4bf06d0c14 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:02.085411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7581-1de2-497d-80e6-7e4bf06d0c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:02.094908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 341/715] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:09:02.100760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103c92-cd2d-4e80-a6c7-ab238e67755d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:02.126552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b5eb7581-1de2-497d-80e6-7e4bf06d0c14 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:02.129214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b5eb7581-1de2-497d-80e6-7e4bf06d0c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:02.215782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 375/716] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:09:02.237628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23103c92-cd2d-4e80-a6c7-ab238e67755d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:02.247205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7581-1de2-497d-80e6-7e4bf06d0c14 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:02.315232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af262deb-fa77-4524-89d4-9b6f4d39e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:02.316064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af262deb-fa77-4524-89d4-9b6f4d39e81f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:02.316348 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af262deb-fa77-4524-89d4-9b6f4d39e81f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:02.316622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af262deb-fa77-4524-89d4-9b6f4d39e81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:02.337075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af262deb-fa77-4524-89d4-9b6f4d39e81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:02.338449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af262deb-fa77-4524-89d4-9b6f4d39e81f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:02.344495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-af262deb-fa77-4524-89d4-9b6f4d39e81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:02.365153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:02.366194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:02.367088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:02.367088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:02.367088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:02.367088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:02.367088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 342/717] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:02.379882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af262deb-fa77-4524-89d4-9b6f4d39e81f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:02.416105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7581-1de2-497d-80e6-7e4bf06d0c14 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:02.445585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:02.453684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f2837-c91f-4d3a-acf0-f6ac3295108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:02.454658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f2837-c91f-4d3a-acf0-f6ac3295108f None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:02.455234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f2837-c91f-4d3a-acf0-f6ac3295108f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:02.455751 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f2837-c91f-4d3a-acf0-f6ac3295108f None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:02.456751 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f2837-c91f-4d3a-acf0-f6ac3295108f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:02.458347 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f2837-c91f-4d3a-acf0-f6ac3295108f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:02.487046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 376/718] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:09:02 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:09:02.607792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af262deb-fa77-4524-89d4-9b6f4d39e81f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:02.664766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226767d6-f3c7-40a5-8c65-d36132036f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:02.665470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226767d6-f3c7-40a5-8c65-d36132036f1d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:02.665757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226767d6-f3c7-40a5-8c65-d36132036f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:02.666039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226767d6-f3c7-40a5-8c65-d36132036f1d None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:02.666788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226767d6-f3c7-40a5-8c65-d36132036f1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:02.667098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226767d6-f3c7-40a5-8c65-d36132036f1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:02.668529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226767d6-f3c7-40a5-8c65-d36132036f1d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:02.686261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 343/719] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:02.692753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f2837-c91f-4d3a-acf0-f6ac3295108f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:02.748742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d460-032e-4f5c-a686-878b6f61dd11 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:02.749059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d460-032e-4f5c-a686-878b6f61dd11 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:02.749303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d460-032e-4f5c-a686-878b6f61dd11 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:02.751757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 344/720] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:02.756706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003177-c224-48ca-aecd-3a5b6b33cff9 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:02.757063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003177-c224-48ca-aecd-3a5b6b33cff9 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:02.757414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003177-c224-48ca-aecd-3a5b6b33cff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:02.777667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-91003177-c224-48ca-aecd-3a5b6b33cff9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:02.779488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-91003177-c224-48ca-aecd-3a5b6b33cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:02.831757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f2837-c91f-4d3a-acf0-f6ac3295108f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:02.843828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:02.873122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 345/721] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:09:02.884262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899f95-0102-4880-9bf5-103f362fcb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:02.885281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899f95-0102-4880-9bf5-103f362fcb0f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:02.885747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899f95-0102-4880-9bf5-103f362fcb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:02.886229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22899f95-0102-4880-9bf5-103f362fcb0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:02.893725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899f95-0102-4880-9bf5-103f362fcb0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:02.895645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22899f95-0102-4880-9bf5-103f362fcb0f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:02.896090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91003177-c224-48ca-aecd-3a5b6b33cff9 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-22899f95-0102-4880-9bf5-103f362fcb0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:02.916511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:02.917501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:02.918398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:02.918398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:02.918398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:02.918398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:02.918398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:02.918398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:02.918398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:02.918398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:02.921030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 377/722] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:02.929217 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899f95-0102-4880-9bf5-103f362fcb0f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:02.995289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:03.018005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91003177-c224-48ca-aecd-3a5b6b33cff9 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:03.055372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22899f95-0102-4880-9bf5-103f362fcb0f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:03.055579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b72b29-657b-4311-a76a-5fb6d94a8385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:03.055579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b72b29-657b-4311-a76a-5fb6d94a8385 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:03.056146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b72b29-657b-4311-a76a-5fb6d94a8385 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:03.056750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b72b29-657b-4311-a76a-5fb6d94a8385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:03.071366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b72b29-657b-4311-a76a-5fb6d94a8385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-f3b72b29-657b-4311-a76a-5fb6d94a8385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:03.076680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:03.077837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:03.078929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:03.085303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 346/723] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:03.087482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b72b29-657b-4311-a76a-5fb6d94a8385 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:03.139791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:03.172083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e4c33-e0a2-48a7-a938-a2d9f349e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:03.172784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e4c33-e0a2-48a7-a938-a2d9f349e0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:03.173053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e4c33-e0a2-48a7-a938-a2d9f349e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:03.173333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e4c33-e0a2-48a7-a938-a2d9f349e0d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:03.174145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e4c33-e0a2-48a7-a938-a2d9f349e0d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:03.174458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e4c33-e0a2-48a7-a938-a2d9f349e0d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:03.175945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e4c33-e0a2-48a7-a938-a2d9f349e0d2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:03.195956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b72b29-657b-4311-a76a-5fb6d94a8385 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:03.209584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 378/724] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:03.226146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e4c33-e0a2-48a7-a938-a2d9f349e0d2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:03.238941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce30042-d692-4d95-8df9-8e6d502416c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:03.239647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce30042-d692-4d95-8df9-8e6d502416c6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:03.239987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce30042-d692-4d95-8df9-8e6d502416c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:03.240933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce30042-d692-4d95-8df9-8e6d502416c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:03.241126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce30042-d692-4d95-8df9-8e6d502416c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:03.241443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce30042-d692-4d95-8df9-8e6d502416c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:03.242828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce30042-d692-4d95-8df9-8e6d502416c6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:03.252644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 347/725] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:03.258391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce30042-d692-4d95-8df9-8e6d502416c6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:03.381918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce30042-d692-4d95-8df9-8e6d502416c6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:03.383523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:03.417452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31454a0-0ed4-4f8a-af3c-bd68c3835414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:03.418230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31454a0-0ed4-4f8a-af3c-bd68c3835414 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:03.418513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31454a0-0ed4-4f8a-af3c-bd68c3835414 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:03.418786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31454a0-0ed4-4f8a-af3c-bd68c3835414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:03.430822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31454a0-0ed4-4f8a-af3c-bd68c3835414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:03.432351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31454a0-0ed4-4f8a-af3c-bd68c3835414 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-b31454a0-0ed4-4f8a-af3c-bd68c3835414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:03.450982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:03.451962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:03.454159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:03.454159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:03.454159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:03.454159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:03.454159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 348/726] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:03.458743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31454a0-0ed4-4f8a-af3c-bd68c3835414 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:03.473863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e4c33-e0a2-48a7-a938-a2d9f349e0d2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:03.501770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:03.550614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc17d-8578-49cc-86fe-f2d8b482f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:03.553259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc17d-8578-49cc-86fe-f2d8b482f706 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:03.553545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc17d-8578-49cc-86fe-f2d8b482f706 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:03.553822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc17d-8578-49cc-86fe-f2d8b482f706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:03.554668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bc17d-8578-49cc-86fe-f2d8b482f706 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=e1ea02cd5e644aaba236acf4e46cb20f) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:03.554980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bc17d-8578-49cc-86fe-f2d8b482f706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:03.558950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bc17d-8578-49cc-86fe-f2d8b482f706 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:03.572160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 379/727] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:03 2022] GET /identity/v3/role_assignments?user.id=e1ea02cd5e644aaba236acf4e46cb20f&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=c6577847f998435991dac5744a94d0ee => generated 259 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:03.641205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31454a0-0ed4-4f8a-af3c-bd68c3835414 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:03.694842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbafa03-8b9b-4443-a462-2b3e6a7c7041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:03.695466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafa03-8b9b-4443-a462-2b3e6a7c7041 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:03.696011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafa03-8b9b-4443-a462-2b3e6a7c7041 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:03.696289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafa03-8b9b-4443-a462-2b3e6a7c7041 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:03.697029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbafa03-8b9b-4443-a462-2b3e6a7c7041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:03.697336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbafa03-8b9b-4443-a462-2b3e6a7c7041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:03.698821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbafa03-8b9b-4443-a462-2b3e6a7c7041 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:03.713073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 349/728] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:03.718100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc17d-8578-49cc-86fe-f2d8b482f706 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:03.882756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc17d-8578-49cc-86fe-f2d8b482f706 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:03.918434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b1b13-5484-49a7-8b18-f862e1d96172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:03.919234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b1b13-5484-49a7-8b18-f862e1d96172 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:03.919540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b1b13-5484-49a7-8b18-f862e1d96172 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:03.919818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b1b13-5484-49a7-8b18-f862e1d96172 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:03.932572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b1b13-5484-49a7-8b18-f862e1d96172 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:03.934445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b1b13-5484-49a7-8b18-f862e1d96172 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d92b1b13-5484-49a7-8b18-f862e1d96172 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:03.952574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:03.953631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:09:03.954574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:03.958607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 380/729] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:03.964097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbafa03-8b9b-4443-a462-2b3e6a7c7041 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:03.991240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:04.115534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbafa03-8b9b-4443-a462-2b3e6a7c7041 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:04.164044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e41e8-36c9-49b3-a52c-d5c137ae09ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:04.164723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e41e8-36c9-49b3-a52c-d5c137ae09ba None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:04.165002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e41e8-36c9-49b3-a52c-d5c137ae09ba None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:04.165275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e41e8-36c9-49b3-a52c-d5c137ae09ba None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:04.166115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e41e8-36c9-49b3-a52c-d5c137ae09ba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:04.166420 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e41e8-36c9-49b3-a52c-d5c137ae09ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:04.167881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e41e8-36c9-49b3-a52c-d5c137ae09ba None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:04.196790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 350/730] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jun 7 14:09:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:04.202173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b1b13-5484-49a7-8b18-f862e1d96172 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:04.261088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:04.347094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b1b13-5484-49a7-8b18-f862e1d96172 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:04.363955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908c39-f54f-4095-8385-a2084d04ed3d None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:04.364295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908c39-f54f-4095-8385-a2084d04ed3d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:04.364515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908c39-f54f-4095-8385-a2084d04ed3d None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:04.365873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 351/731] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:04.376747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34017d4-2251-49c0-864f-2f622fd6d7d2 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:04.377062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34017d4-2251-49c0-864f-2f622fd6d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:04.377314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34017d4-2251-49c0-864f-2f622fd6d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:04.402210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42dcf1-673b-4d41-a724-dcedf9f8e0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:04.406837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42dcf1-673b-4d41-a724-dcedf9f8e0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:04.407359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42dcf1-673b-4d41-a724-dcedf9f8e0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:04.407789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42dcf1-673b-4d41-a724-dcedf9f8e0b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:04.408447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-c34017d4-2251-49c0-864f-2f622fd6d7d2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:04.415292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c34017d4-2251-49c0-864f-2f622fd6d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:04.516611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42dcf1-673b-4d41-a724-dcedf9f8e0b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:04.518306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42dcf1-673b-4d41-a724-dcedf9f8e0b9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:04.538073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 352/732] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:09:04.551555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:04.576346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34017d4-2251-49c0-864f-2f622fd6d7d2 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:04.580493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:04.673952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 381/733] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 07 14:09:04.681093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42dcf1-673b-4d41-a724-dcedf9f8e0b9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:04.748451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34017d4-2251-49c0-864f-2f622fd6d7d2 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:04.814138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d8ebc-0b4e-4a95-a998-ec8248a8d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:04.815200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8ebc-0b4e-4a95-a998-ec8248a8d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:04.815643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8ebc-0b4e-4a95-a998-ec8248a8d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:04.816058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d8ebc-0b4e-4a95-a998-ec8248a8d8f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:04.832925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d8ebc-0b4e-4a95-a998-ec8248a8d8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-761d8ebc-0b4e-4a95-a998-ec8248a8d8f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:04.843714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:04.845235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:09:04.846119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:04.848333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42dcf1-673b-4d41-a724-dcedf9f8e0b9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:04.850182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 353/734] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:09:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:04.851758 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a891-cdd7-46bc-9194-9d9e61ff6ca7 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:04.852207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a891-cdd7-46bc-9194-9d9e61ff6ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:04.852615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a891-cdd7-46bc-9194-9d9e61ff6ca7 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:04.858012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 354/735] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:04.858584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a891-cdd7-46bc-9194-9d9e61ff6ca7 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:04.888347 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:04.897278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81f42c-ebcd-4637-8701-4cd9c6b15a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:04.899298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81f42c-ebcd-4637-8701-4cd9c6b15a6d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:04.899801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81f42c-ebcd-4637-8701-4cd9c6b15a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:04.900757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81f42c-ebcd-4637-8701-4cd9c6b15a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:04.915321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81f42c-ebcd-4637-8701-4cd9c6b15a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:04.916900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81f42c-ebcd-4637-8701-4cd9c6b15a6d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:04.939949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-5f81f42c-ebcd-4637-8701-4cd9c6b15a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:04.943176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:04.944523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:04.945517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:04.945517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:04.945517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:04.945517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:04.945517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 382/736] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:04.953085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a59ef-fae8-4484-a8e9-834da9008a92 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:04.953085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a59ef-fae8-4484-a8e9-834da9008a92 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:04.953085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a59ef-fae8-4484-a8e9-834da9008a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:04.975802 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9b7a59ef-fae8-4484-a8e9-834da9008a92 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:04.977258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9b7a59ef-fae8-4484-a8e9-834da9008a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:05.000888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a891-cdd7-46bc-9194-9d9e61ff6ca7 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.042046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793cae-ca95-45e1-845e-b202b59fcdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:05.043085 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793cae-ca95-45e1-845e-b202b59fcdad None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.043713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793cae-ca95-45e1-845e-b202b59fcdad None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.044322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90793cae-ca95-45e1-845e-b202b59fcdad None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.045392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90793cae-ca95-45e1-845e-b202b59fcdad None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:05.045923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90793cae-ca95-45e1-845e-b202b59fcdad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:05.047557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90793cae-ca95-45e1-845e-b202b59fcdad None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:05.057309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 355/737] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:09:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:05.058580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793cae-ca95-45e1-845e-b202b59fcdad None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:05.075448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 383/738] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 07 14:09:05.075448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a59ef-fae8-4484-a8e9-834da9008a92 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:05.193015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a59ef-fae8-4484-a8e9-834da9008a92 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.200384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90793cae-ca95-45e1-845e-b202b59fcdad None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.210644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:05.228979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:05.238164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9367301-1979-4a35-8dcf-82c433628b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:05.239266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367301-1979-4a35-8dcf-82c433628b74 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.239824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367301-1979-4a35-8dcf-82c433628b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.240369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9367301-1979-4a35-8dcf-82c433628b74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.242426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0474df9-0889-4d70-b0fb-4e96310dce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:05.243563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0474df9-0889-4d70-b0fb-4e96310dce16 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.244502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0474df9-0889-4d70-b0fb-4e96310dce16 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.245000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0474df9-0889-4d70-b0fb-4e96310dce16 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.245992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0474df9-0889-4d70-b0fb-4e96310dce16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:05.246580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0474df9-0889-4d70-b0fb-4e96310dce16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:05.248247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0474df9-0889-4d70-b0fb-4e96310dce16 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:05.253600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9367301-1979-4a35-8dcf-82c433628b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:05.255040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9367301-1979-4a35-8dcf-82c433628b74 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:05.267666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 356/739] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:05.268819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0474df9-0889-4d70-b0fb-4e96310dce16 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b9367301-1979-4a35-8dcf-82c433628b74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:05.276236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:05.277308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:05.278415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:05.278415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:05.278415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:05.278415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:05.278415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 384/740] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:05.278415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9367301-1979-4a35-8dcf-82c433628b74 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:05.382027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0474df9-0889-4d70-b0fb-4e96310dce16 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.383960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9367301-1979-4a35-8dcf-82c433628b74 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.418625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c54961-f6dd-494f-9dba-d71e4ffc3a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:05.419515 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c54961-f6dd-494f-9dba-d71e4ffc3a5b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.419763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c54961-f6dd-494f-9dba-d71e4ffc3a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.420037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c54961-f6dd-494f-9dba-d71e4ffc3a5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.420135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35154f56-6426-4467-8ef5-9f1c94a24af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:05.420787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35154f56-6426-4467-8ef5-9f1c94a24af4 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.421075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35154f56-6426-4467-8ef5-9f1c94a24af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.421350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35154f56-6426-4467-8ef5-9f1c94a24af4 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.422624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35154f56-6426-4467-8ef5-9f1c94a24af4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:05.424047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35154f56-6426-4467-8ef5-9f1c94a24af4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:05.428100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c54961-f6dd-494f-9dba-d71e4ffc3a5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:05.429281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c54961-f6dd-494f-9dba-d71e4ffc3a5b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:05.440385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 357/741] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:09:05 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:05.441982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f3c0-8d75-43f6-a673-9e490648a78c None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.442485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f3c0-8d75-43f6-a673-9e490648a78c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.442985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f3c0-8d75-43f6-a673-9e490648a78c None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-96c54961-f6dd-494f-9dba-d71e4ffc3a5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:05.444003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:05.444902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:05.446122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:05.446122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:05.446122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:05.446122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:05.446122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:05.446122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:05.446122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:05.446122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:05.448992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 358/742] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:05.450186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f3c0-8d75-43f6-a673-9e490648a78c None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:05.454401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 385/743] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:05.455940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f0557-5113-4831-95c3-10d28a2d7f19 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.456234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f0557-5113-4831-95c3-10d28a2d7f19 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.456510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f0557-5113-4831-95c3-10d28a2d7f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.477413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-511f0557-5113-4831-95c3-10d28a2d7f19 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:05.478618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-511f0557-5113-4831-95c3-10d28a2d7f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:05.510630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:05.530131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:05.593924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 386/744] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:05.595235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f0557-5113-4831-95c3-10d28a2d7f19 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:05.614694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f3c0-8d75-43f6-a673-9e490648a78c None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.665359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1356-9360-4ef3-b97c-a9923d51c706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:05.666277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1356-9360-4ef3-b97c-a9923d51c706 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.666631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1356-9360-4ef3-b97c-a9923d51c706 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.667515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed1356-9360-4ef3-b97c-a9923d51c706 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.667641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed1356-9360-4ef3-b97c-a9923d51c706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:05.667965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed1356-9360-4ef3-b97c-a9923d51c706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:05.669312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed1356-9360-4ef3-b97c-a9923d51c706 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:05.682781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 359/745] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:05.687311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1356-9360-4ef3-b97c-a9923d51c706 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:05.718479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f0557-5113-4831-95c3-10d28a2d7f19 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.759135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d4bb1-91f0-4e37-8157-0bf103cef255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:05.760747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d4bb1-91f0-4e37-8157-0bf103cef255 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.761030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d4bb1-91f0-4e37-8157-0bf103cef255 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.761306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d4bb1-91f0-4e37-8157-0bf103cef255 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.762102 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d4bb1-91f0-4e37-8157-0bf103cef255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:05.762409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d4bb1-91f0-4e37-8157-0bf103cef255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:05.763870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d4bb1-91f0-4e37-8157-0bf103cef255 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:05.779986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 387/746] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:05.783419 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d4bb1-91f0-4e37-8157-0bf103cef255 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:05.800624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:05.801778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed1356-9360-4ef3-b97c-a9923d51c706 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.805359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:05.850176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7336ca-5103-47e4-9599-235371ddc371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:05.850996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7336ca-5103-47e4-9599-235371ddc371 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.851462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7336ca-5103-47e4-9599-235371ddc371 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.851747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7336ca-5103-47e4-9599-235371ddc371 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.852529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7336ca-5103-47e4-9599-235371ddc371 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:05.853891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7336ca-5103-47e4-9599-235371ddc371 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-9d7336ca-5103-47e4-9599-235371ddc371 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:05.868165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:05.869298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:09:05.870346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:05.874462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 360/747] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Jun 7 14:09:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:05.875320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7336ca-5103-47e4-9599-235371ddc371 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:05.918352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d4bb1-91f0-4e37-8157-0bf103cef255 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.959919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae193e-9f31-417f-8005-f3c734ba6bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:05.960740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae193e-9f31-417f-8005-f3c734ba6bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:05.961025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae193e-9f31-417f-8005-f3c734ba6bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:05.961305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae193e-9f31-417f-8005-f3c734ba6bc9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:05.971377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae193e-9f31-417f-8005-f3c734ba6bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:05.973367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae193e-9f31-417f-8005-f3c734ba6bc9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:05.992793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7336ca-5103-47e4-9599-235371ddc371 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-77ae193e-9f31-417f-8005-f3c734ba6bc9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:05.993056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:05.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:05.994947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 388/748] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:09:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:05.996973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae193e-9f31-417f-8005-f3c734ba6bc9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:06.032485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4021fb3-72d9-4cbe-9b51-fa58bb684dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:06.033427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4021fb3-72d9-4cbe-9b51-fa58bb684dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.033810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4021fb3-72d9-4cbe-9b51-fa58bb684dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.034194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4021fb3-72d9-4cbe-9b51-fa58bb684dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.035136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4021fb3-72d9-4cbe-9b51-fa58bb684dc7 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=ee8475d17d2349559125d2bcd969b9f5) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:06.035595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4021fb3-72d9-4cbe-9b51-fa58bb684dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:06.037371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4021fb3-72d9-4cbe-9b51-fa58bb684dc7 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:06.046263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 361/749] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:05 2022] GET /identity/v3/role_assignments?user.id=ee8475d17d2349559125d2bcd969b9f5&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=c6577847f998435991dac5744a94d0ee => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:06.047843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4021fb3-72d9-4cbe-9b51-fa58bb684dc7 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:06.104748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:06.145511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:06.191668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae193e-9f31-417f-8005-f3c734ba6bc9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:06.201990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4021fb3-72d9-4cbe-9b51-fa58bb684dc7 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:06.232057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1f3c8-4da7-4caa-93ed-a8249d696b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:06.233381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1f3c8-4da7-4caa-93ed-a8249d696b28 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.233872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1f3c8-4da7-4caa-93ed-a8249d696b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.234935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1f3c8-4da7-4caa-93ed-a8249d696b28 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.235839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1f3c8-4da7-4caa-93ed-a8249d696b28 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:06.236317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1f3c8-4da7-4caa-93ed-a8249d696b28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:06.238143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1f3c8-4da7-4caa-93ed-a8249d696b28 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:06.249804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 389/750] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jun 7 14:09:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:06.249804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee418521-000e-41ab-983e-c94ff8548c52 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.249804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee418521-000e-41ab-983e-c94ff8548c52 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.249804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee418521-000e-41ab-983e-c94ff8548c52 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.249804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 390/751] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:06.251681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3f4de-8a11-4049-b411-4c0d3d39c64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:06.252250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3f4de-8a11-4049-b411-4c0d3d39c64e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.252556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3f4de-8a11-4049-b411-4c0d3d39c64e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.252828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3f4de-8a11-4049-b411-4c0d3d39c64e None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.254477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee418521-000e-41ab-983e-c94ff8548c52 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:06.255017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3f4de-8a11-4049-b411-4c0d3d39c64e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:06.255361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3f4de-8a11-4049-b411-4c0d3d39c64e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:06.257218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3f4de-8a11-4049-b411-4c0d3d39c64e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:06.277380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 362/752] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jun 7 14:09:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:06.278771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c196-e325-4528-8485-e49c1bb382ed None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.279146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c196-e325-4528-8485-e49c1bb382ed None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.279513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c196-e325-4528-8485-e49c1bb382ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.297489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d6e3c196-e325-4528-8485-e49c1bb382ed None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:06.298857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d6e3c196-e325-4528-8485-e49c1bb382ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:06.379263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee418521-000e-41ab-983e-c94ff8548c52 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:06.379506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 363/753] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:06.380232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3c196-e325-4528-8485-e49c1bb382ed None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:06.417851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:06.438886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ab35d-75e3-4b2c-8e94-0516f45b810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:06.439584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ab35d-75e3-4b2c-8e94-0516f45b810e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.439867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ab35d-75e3-4b2c-8e94-0516f45b810e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.440141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ab35d-75e3-4b2c-8e94-0516f45b810e None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.441298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ab35d-75e3-4b2c-8e94-0516f45b810e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:06.441617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ab35d-75e3-4b2c-8e94-0516f45b810e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:06.443512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ab35d-75e3-4b2c-8e94-0516f45b810e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:06.446864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:06.452285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 391/754] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jun 7 14:09:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:06.453234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ab35d-75e3-4b2c-8e94-0516f45b810e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:06.516314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3c196-e325-4528-8485-e49c1bb382ed None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:06.560615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a049f9-4596-439a-a3e3-2f1212bf33c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:06.561530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a049f9-4596-439a-a3e3-2f1212bf33c7 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.561821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a049f9-4596-439a-a3e3-2f1212bf33c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.562099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a049f9-4596-439a-a3e3-2f1212bf33c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.566431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ab35d-75e3-4b2c-8e94-0516f45b810e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:06.610659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859faa9-f4d0-4b66-a73b-52be958470fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:06.611534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859faa9-f4d0-4b66-a73b-52be958470fd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.611819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859faa9-f4d0-4b66-a73b-52be958470fd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.612095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859faa9-f4d0-4b66-a73b-52be958470fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.625984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859faa9-f4d0-4b66-a73b-52be958470fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e859faa9-f4d0-4b66-a73b-52be958470fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:06.636167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:06.637101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:06.637951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:06.639488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 392/755] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:06.640363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859faa9-f4d0-4b66-a73b-52be958470fd None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:06.649592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a049f9-4596-439a-a3e3-2f1212bf33c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:06.651104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a049f9-4596-439a-a3e3-2f1212bf33c7 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:06.674035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:06.719088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:06.761826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 364/756] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:09:06.763057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a049f9-4596-439a-a3e3-2f1212bf33c7 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:06.771374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859faa9-f4d0-4b66-a73b-52be958470fd None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:06.806960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62cfba-a14f-42e3-b0d7-5b76249bd820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:06.807650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62cfba-a14f-42e3-b0d7-5b76249bd820 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.807953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62cfba-a14f-42e3-b0d7-5b76249bd820 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.808384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62cfba-a14f-42e3-b0d7-5b76249bd820 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.808992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62cfba-a14f-42e3-b0d7-5b76249bd820 None admin] RBAC: Adding query filter params (interface=public, service_id=9b3dc272c0cb413fb3fc7489a8d85be8, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:06.809359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62cfba-a14f-42e3-b0d7-5b76249bd820 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:06.810725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62cfba-a14f-42e3-b0d7-5b76249bd820 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:06.818435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 393/757] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jun 7 14:09:06 2022] GET /identity/v3/endpoints?service_id=9b3dc272c0cb413fb3fc7489a8d85be8&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:06.819228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62cfba-a14f-42e3-b0d7-5b76249bd820 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:06.871663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a049f9-4596-439a-a3e3-2f1212bf33c7 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:06.894098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:06.910915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70442880-0226-4de8-9341-03e5632e1304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:06.911865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70442880-0226-4de8-9341-03e5632e1304 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.912300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70442880-0226-4de8-9341-03e5632e1304 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.912725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70442880-0226-4de8-9341-03e5632e1304 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.913627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70442880-0226-4de8-9341-03e5632e1304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:06.914113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70442880-0226-4de8-9341-03e5632e1304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:06.915657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70442880-0226-4de8-9341-03e5632e1304 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:06.925074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 365/758] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:06.925390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62cfba-a14f-42e3-b0d7-5b76249bd820 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:06.926253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70442880-0226-4de8-9341-03e5632e1304 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:06.954711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:06.966788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e53f19-0565-4976-93d7-79b967809546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:06.967393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e53f19-0565-4976-93d7-79b967809546 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:06.967677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e53f19-0565-4976-93d7-79b967809546 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:06.967950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e53f19-0565-4976-93d7-79b967809546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:06.979552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e53f19-0565-4976-93d7-79b967809546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:06.980920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e53f19-0565-4976-93d7-79b967809546 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-64e53f19-0565-4976-93d7-79b967809546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:06.998026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:06.999187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:07.000441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:07.000441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:07.000441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:07.000441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:07.000441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 394/759] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:07.000441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e53f19-0565-4976-93d7-79b967809546 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:07.042480 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70442880-0226-4de8-9341-03e5632e1304 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:07.077485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328b27c-4dc0-471f-9d04-c951fba41b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:07.078963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328b27c-4dc0-471f-9d04-c951fba41b65 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:07.079434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328b27c-4dc0-471f-9d04-c951fba41b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:07.079888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328b27c-4dc0-471f-9d04-c951fba41b65 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:07.080717 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328b27c-4dc0-471f-9d04-c951fba41b65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:07.082247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328b27c-4dc0-471f-9d04-c951fba41b65 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:07.087684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 366/760] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jun 7 14:09:06 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:07.088653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328b27c-4dc0-471f-9d04-c951fba41b65 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:07.104197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e53f19-0565-4976-93d7-79b967809546 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:07.140160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005257ca-0e02-4b06-8cc6-cb90eb33bec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:07.141167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:07.141524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005257ca-0e02-4b06-8cc6-cb90eb33bec0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:07.142290 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005257ca-0e02-4b06-8cc6-cb90eb33bec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:07.142582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005257ca-0e02-4b06-8cc6-cb90eb33bec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:07.154903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005257ca-0e02-4b06-8cc6-cb90eb33bec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:07.157111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005257ca-0e02-4b06-8cc6-cb90eb33bec0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-005257ca-0e02-4b06-8cc6-cb90eb33bec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:07.175184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:07.176433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:07.177566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:07.177566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:07.177566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:07.177566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:07.177566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 395/761] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:07.182586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005257ca-0e02-4b06-8cc6-cb90eb33bec0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:07.204498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328b27c-4dc0-471f-9d04-c951fba41b65 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:07.214520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:07.242707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9931c7e-a7a0-42c1-a2f7-cb9f92ef9161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:07.243841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9931c7e-a7a0-42c1-a2f7-cb9f92ef9161 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:07.244369 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9931c7e-a7a0-42c1-a2f7-cb9f92ef9161 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:07.244932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9931c7e-a7a0-42c1-a2f7-cb9f92ef9161 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:07.245917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9931c7e-a7a0-42c1-a2f7-cb9f92ef9161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:07.246433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9931c7e-a7a0-42c1-a2f7-cb9f92ef9161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:07.248265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9931c7e-a7a0-42c1-a2f7-cb9f92ef9161 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:07.263381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 367/762] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:07.274208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9931c7e-a7a0-42c1-a2f7-cb9f92ef9161 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:07.300036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005257ca-0e02-4b06-8cc6-cb90eb33bec0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:07.364358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010bd14-6738-4af5-8fc8-aee5e60a937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:07.365112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010bd14-6738-4af5-8fc8-aee5e60a937a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:07.365333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010bd14-6738-4af5-8fc8-aee5e60a937a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:07.365608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010bd14-6738-4af5-8fc8-aee5e60a937a None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:07.366349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010bd14-6738-4af5-8fc8-aee5e60a937a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:07.366652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010bd14-6738-4af5-8fc8-aee5e60a937a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:07.368043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010bd14-6738-4af5-8fc8-aee5e60a937a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:07.392704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 396/763] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:07.400785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010bd14-6738-4af5-8fc8-aee5e60a937a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:07.410649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9931c7e-a7a0-42c1-a2f7-cb9f92ef9161 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:07.420375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:07.458163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede25683-96f4-4a3b-b01e-ef17bb25d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:07.458688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede25683-96f4-4a3b-b01e-ef17bb25d00c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:07.459075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede25683-96f4-4a3b-b01e-ef17bb25d00c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:07.459512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede25683-96f4-4a3b-b01e-ef17bb25d00c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:07.467372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede25683-96f4-4a3b-b01e-ef17bb25d00c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:07.469037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede25683-96f4-4a3b-b01e-ef17bb25d00c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-ede25683-96f4-4a3b-b01e-ef17bb25d00c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:07.483842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:07.484960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:07.486069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:07.486069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:07.486069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:07.486069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:07.486069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:07.486069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:07.486069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:07.486069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:07.493751 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 368/764] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:07.493751 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede25683-96f4-4a3b-b01e-ef17bb25d00c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:07.539958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:07.555457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010bd14-6738-4af5-8fc8-aee5e60a937a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:07.602891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584f617-d1ca-4d51-a859-e0048e8149ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:07.604163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584f617-d1ca-4d51-a859-e0048e8149ad None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:07.604452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584f617-d1ca-4d51-a859-e0048e8149ad None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:07.604733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584f617-d1ca-4d51-a859-e0048e8149ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:07.610733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede25683-96f4-4a3b-b01e-ef17bb25d00c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:07.614439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584f617-d1ca-4d51-a859-e0048e8149ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:07.615947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584f617-d1ca-4d51-a859-e0048e8149ad None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8584f617-d1ca-4d51-a859-e0048e8149ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:07.636883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:07.637913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:07.639932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 397/765] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jun 7 14:09:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:07.643980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584f617-d1ca-4d51-a859-e0048e8149ad None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:07.683714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b7932-8d9c-46d1-8e42-1553998514ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:07.684944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b7932-8d9c-46d1-8e42-1553998514ad None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:07.685509 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b7932-8d9c-46d1-8e42-1553998514ad None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:07.686640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b7932-8d9c-46d1-8e42-1553998514ad None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:07.689519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b7932-8d9c-46d1-8e42-1553998514ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:07.690794 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b7932-8d9c-46d1-8e42-1553998514ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:07.692920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b7932-8d9c-46d1-8e42-1553998514ad None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:07.724131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 369/766] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:07.728479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b7932-8d9c-46d1-8e42-1553998514ad None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:07.765195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:07.864258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584f617-d1ca-4d51-a859-e0048e8149ad None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:07.893845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b7932-8d9c-46d1-8e42-1553998514ad None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:07.926159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b4737-0fb2-4233-af7f-295b8ff9fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:07.926876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b4737-0fb2-4233-af7f-295b8ff9fff1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:07.927195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b4737-0fb2-4233-af7f-295b8ff9fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:07.927484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b4737-0fb2-4233-af7f-295b8ff9fff1 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:07.928338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b4737-0fb2-4233-af7f-295b8ff9fff1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:07.928650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b4737-0fb2-4233-af7f-295b8ff9fff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:07.930432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b4737-0fb2-4233-af7f-295b8ff9fff1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:07.940542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a7fa3-7aa2-4937-b1f7-d50ffcafb64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:07.941566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a7fa3-7aa2-4937-b1f7-d50ffcafb64a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:07.942065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a7fa3-7aa2-4937-b1f7-d50ffcafb64a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:07.942552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a7fa3-7aa2-4937-b1f7-d50ffcafb64a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:07.943740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a7fa3-7aa2-4937-b1f7-d50ffcafb64a None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=ff1e9d0a33d54a57af28874b4a57738a) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:07.944269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a7fa3-7aa2-4937-b1f7-d50ffcafb64a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:07.946336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a7fa3-7aa2-4937-b1f7-d50ffcafb64a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:07.950610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 398/767] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jun 7 14:09:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:07.957691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b4737-0fb2-4233-af7f-295b8ff9fff1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:07.959609 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 370/768] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:07 2022] GET /identity/v3/role_assignments?user.id=ff1e9d0a33d54a57af28874b4a57738a&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:07.965891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:08.070311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a2602-3133-4155-a263-35a4bb8b2ce4 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.070804 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a2602-3133-4155-a263-35a4bb8b2ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.071089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a2602-3133-4155-a263-35a4bb8b2ce4 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.073511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 371/769] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:08.081107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae7ec0-5165-4ef2-adb4-34db3a622e46 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.081409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae7ec0-5165-4ef2-adb4-34db3a622e46 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.081693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae7ec0-5165-4ef2-adb4-34db3a622e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.123326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7eae7ec0-5165-4ef2-adb4-34db3a622e46 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:08.125298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7eae7ec0-5165-4ef2-adb4-34db3a622e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:08.154308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b4737-0fb2-4233-af7f-295b8ff9fff1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:08.225268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727319b5-b812-4887-9141-8abe4314b14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:08.226071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727319b5-b812-4887-9141-8abe4314b14f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.226349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727319b5-b812-4887-9141-8abe4314b14f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.226622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727319b5-b812-4887-9141-8abe4314b14f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.246822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727319b5-b812-4887-9141-8abe4314b14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:08.249554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727319b5-b812-4887-9141-8abe4314b14f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:08.274215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 372/770] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-727319b5-b812-4887-9141-8abe4314b14f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:08.279696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:08.280611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:08.282074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:08.282074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:08.282074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:08.282074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:08.282074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 399/771] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:08.287140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae7ec0-5165-4ef2-adb4-34db3a622e46 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:08.307690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727319b5-b812-4887-9141-8abe4314b14f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:08.329523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:08.407692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:08.453641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727319b5-b812-4887-9141-8abe4314b14f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:08.513466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae7ec0-5165-4ef2-adb4-34db3a622e46 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:08.527396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1117e-0a0c-4760-bf5a-18d80bfa998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:08.528160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1117e-0a0c-4760-bf5a-18d80bfa998e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.528445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1117e-0a0c-4760-bf5a-18d80bfa998e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.528724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1117e-0a0c-4760-bf5a-18d80bfa998e None admin] PATH_INFO: `/v3/services/network` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.529390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1117e-0a0c-4760-bf5a-18d80bfa998e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:08.530752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1117e-0a0c-4760-bf5a-18d80bfa998e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-cdf1117e-0a0c-4760-bf5a-18d80bfa998e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:08.550059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:08.551101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:08.553093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 400/772] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:08 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:08.561242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1117e-0a0c-4760-bf5a-18d80bfa998e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:08.583723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fa6aa-1556-4fd5-9058-c438af19799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:08.584326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fa6aa-1556-4fd5-9058-c438af19799b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.584613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fa6aa-1556-4fd5-9058-c438af19799b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.584893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fa6aa-1556-4fd5-9058-c438af19799b None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.585633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fa6aa-1556-4fd5-9058-c438af19799b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:08.585942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fa6aa-1556-4fd5-9058-c438af19799b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:08.587329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fa6aa-1556-4fd5-9058-c438af19799b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:08.613977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 373/773] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:08.620063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fa6aa-1556-4fd5-9058-c438af19799b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:08.732870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1117e-0a0c-4760-bf5a-18d80bfa998e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:08.739683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:08.762966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fa6aa-1556-4fd5-9058-c438af19799b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:08.767445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:08.784023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328e1c8-390c-456f-9d5b-616852062b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:08.785023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328e1c8-390c-456f-9d5b-616852062b14 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.785538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328e1c8-390c-456f-9d5b-616852062b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.786048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328e1c8-390c-456f-9d5b-616852062b14 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.787554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328e1c8-390c-456f-9d5b-616852062b14 None admin] RBAC: Adding query filter params (name=network) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:08.788333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328e1c8-390c-456f-9d5b-616852062b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:08.790553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328e1c8-390c-456f-9d5b-616852062b14 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:08.797981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 401/774] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:08.799626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271261b-47e8-4b95-b8e5-1f43aba5987d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.800099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271261b-47e8-4b95-b8e5-1f43aba5987d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.800385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271261b-47e8-4b95-b8e5-1f43aba5987d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.801726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78ccb1-68cd-4923-b201-721abc4bcc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:08.802006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 402/775] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:08.802950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78ccb1-68cd-4923-b201-721abc4bcc3e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.803237 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78ccb1-68cd-4923-b201-721abc4bcc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.803547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78ccb1-68cd-4923-b201-721abc4bcc3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.807566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cf783-73ef-405a-b4b4-9e669eb298f0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.808086 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cf783-73ef-405a-b4b4-9e669eb298f0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.808572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cf783-73ef-405a-b4b4-9e669eb298f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.811417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78ccb1-68cd-4923-b201-721abc4bcc3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:08.813577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78ccb1-68cd-4923-b201-721abc4bcc3e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:08.828814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5b7cf783-73ef-405a-b4b4-9e669eb298f0 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-8c78ccb1-68cd-4923-b201-721abc4bcc3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:08.829209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:08.830079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 374/776] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:08.832067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78ccb1-68cd-4923-b201-721abc4bcc3e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:08.834722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5b7cf783-73ef-405a-b4b4-9e669eb298f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:08.912502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 403/777] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:08.913463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cf783-73ef-405a-b4b4-9e669eb298f0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:08.938902 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78ccb1-68cd-4923-b201-721abc4bcc3e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:08.974654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bfebc-dd55-4338-9f84-eceb20afcfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:08.975325 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bfebc-dd55-4338-9f84-eceb20afcfea None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:08.975639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bfebc-dd55-4338-9f84-eceb20afcfea None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:08.975919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bfebc-dd55-4338-9f84-eceb20afcfea None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:08.976633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bfebc-dd55-4338-9f84-eceb20afcfea None admin] RBAC: Adding query filter params (type=network) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:08.976941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bfebc-dd55-4338-9f84-eceb20afcfea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:08.978303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21bfebc-dd55-4338-9f84-eceb20afcfea None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:08.983578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 375/778] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:08.984642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bfebc-dd55-4338-9f84-eceb20afcfea None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:08.988268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:09.022324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cf783-73ef-405a-b4b4-9e669eb298f0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:09.040220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:09.060173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92407c-db22-417d-9f89-e154b62175e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:09.061069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92407c-db22-417d-9f89-e154b62175e1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.061493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92407c-db22-417d-9f89-e154b62175e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.061910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92407c-db22-417d-9f89-e154b62175e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.063385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92407c-db22-417d-9f89-e154b62175e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:09.063859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92407c-db22-417d-9f89-e154b62175e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:09.065597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92407c-db22-417d-9f89-e154b62175e1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:09.084058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 404/779] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:09.085391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92407c-db22-417d-9f89-e154b62175e1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:09.091040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bfebc-dd55-4338-9f84-eceb20afcfea None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:09.126909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70db242-ca84-4efc-80f9-2c8eb49d4c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:09.127735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70db242-ca84-4efc-80f9-2c8eb49d4c9f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.128020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70db242-ca84-4efc-80f9-2c8eb49d4c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.128294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70db242-ca84-4efc-80f9-2c8eb49d4c9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.138876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70db242-ca84-4efc-80f9-2c8eb49d4c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-f70db242-ca84-4efc-80f9-2c8eb49d4c9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:09.147113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:09.148236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:09.149177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 376/780] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:09.149866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70db242-ca84-4efc-80f9-2c8eb49d4c9f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:09.201735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92407c-db22-417d-9f89-e154b62175e1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:09.216390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:09.241133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253fa44-402e-44f2-b0eb-a48a4b43fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:09.242088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253fa44-402e-44f2-b0eb-a48a4b43fd94 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.242593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253fa44-402e-44f2-b0eb-a48a4b43fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.243053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253fa44-402e-44f2-b0eb-a48a4b43fd94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.244096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253fa44-402e-44f2-b0eb-a48a4b43fd94 None admin] RBAC: Adding query filter params (interface=public, service_id=0d2335a95a3f40af8279fc643e3c8a17, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:09.244552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253fa44-402e-44f2-b0eb-a48a4b43fd94 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:09.246215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253fa44-402e-44f2-b0eb-a48a4b43fd94 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:09.253363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 405/781] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jun 7 14:09:09 2022] GET /identity/v3/endpoints?service_id=0d2335a95a3f40af8279fc643e3c8a17&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:09.254346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253fa44-402e-44f2-b0eb-a48a4b43fd94 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:09.259762 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70db242-ca84-4efc-80f9-2c8eb49d4c9f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:09.295044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291453-a634-4ada-a3a0-8638ac371fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:09.295979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291453-a634-4ada-a3a0-8638ac371fe9 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.296266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291453-a634-4ada-a3a0-8638ac371fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.297081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291453-a634-4ada-a3a0-8638ac371fe9 None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/e1ea02cd5e644aaba236acf4e46cb20f/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.299410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca291453-a634-4ada-a3a0-8638ac371fe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=e1ea02cd5e644aaba236acf4e46cb20f, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:09.300616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca291453-a634-4ada-a3a0-8638ac371fe9 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:09.301655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:09.323378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 377/782] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:09:09 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/e1ea02cd5e644aaba236acf4e46cb20f/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:09:09.323378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291453-a634-4ada-a3a0-8638ac371fe9 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:09.433230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253fa44-402e-44f2-b0eb-a48a4b43fd94 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:09.501048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e92fd-2744-491c-966d-384a6f3eaa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:09.501732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e92fd-2744-491c-966d-384a6f3eaa38 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.502018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e92fd-2744-491c-966d-384a6f3eaa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.502298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e92fd-2744-491c-966d-384a6f3eaa38 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.503066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e92fd-2744-491c-966d-384a6f3eaa38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:09.503845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e92fd-2744-491c-966d-384a6f3eaa38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:09.506693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e92fd-2744-491c-966d-384a6f3eaa38 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:09.516452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 406/783] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:09.522208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e92fd-2744-491c-966d-384a6f3eaa38 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:09.564576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291453-a634-4ada-a3a0-8638ac371fe9 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:09.596274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:09.613122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765ee37-6d94-4ff5-bc18-a9c3edc354e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:09.613798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765ee37-6d94-4ff5-bc18-a9c3edc354e7 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.614086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765ee37-6d94-4ff5-bc18-a9c3edc354e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.614612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765ee37-6d94-4ff5-bc18-a9c3edc354e7 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.615358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765ee37-6d94-4ff5-bc18-a9c3edc354e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:09.616868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765ee37-6d94-4ff5-bc18-a9c3edc354e7 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:09.622819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 378/784] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jun 7 14:09:09 2022] GET /identity/v3/services => generated 772 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:09.658334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e92fd-2744-491c-966d-384a6f3eaa38 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:09.660399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:09.696607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae072bbe-17a8-401d-9977-3b05b5b1c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:09.697320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae072bbe-17a8-401d-9977-3b05b5b1c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.697601 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae072bbe-17a8-401d-9977-3b05b5b1c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.697875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae072bbe-17a8-401d-9977-3b05b5b1c7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.709379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae072bbe-17a8-401d-9977-3b05b5b1c7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:09.710835 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae072bbe-17a8-401d-9977-3b05b5b1c7e5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ae072bbe-17a8-401d-9977-3b05b5b1c7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:09.729403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:09.730421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:09.731380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:09.731380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:09.731380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:09.731380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:09.731380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 407/785] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:09.737036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765ee37-6d94-4ff5-bc18-a9c3edc354e7 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:09.885134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08e41b-fed0-46b5-95dd-fa7e2336eb88 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.885471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08e41b-fed0-46b5-95dd-fa7e2336eb88 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.885711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08e41b-fed0-46b5-95dd-fa7e2336eb88 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.887303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 408/786] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:09.889926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765ee37-6d94-4ff5-bc18-a9c3edc354e7 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:09.893713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85771da-681b-4883-8ec3-86df463eac07 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.893713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85771da-681b-4883-8ec3-86df463eac07 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.893907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85771da-681b-4883-8ec3-86df463eac07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.917682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a85771da-681b-4883-8ec3-86df463eac07 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:09.919043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a85771da-681b-4883-8ec3-86df463eac07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:09.930073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaa5d7-9f4d-4550-9f7d-8e5de7dae462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:09.931064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa5d7-9f4d-4550-9f7d-8e5de7dae462 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:09.931678 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa5d7-9f4d-4550-9f7d-8e5de7dae462 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:09.932184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaa5d7-9f4d-4550-9f7d-8e5de7dae462 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:09.933273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaa5d7-9f4d-4550-9f7d-8e5de7dae462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:09.933793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaa5d7-9f4d-4550-9f7d-8e5de7dae462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:09.935676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaa5d7-9f4d-4550-9f7d-8e5de7dae462 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:09.950180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 379/787] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:09.956161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaa5d7-9f4d-4550-9f7d-8e5de7dae462 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:10.019581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 409/788] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:10.035698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:10.054439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85771da-681b-4883-8ec3-86df463eac07 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:10.121856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaa5d7-9f4d-4550-9f7d-8e5de7dae462 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:10.158199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ff544-fd97-4819-a836-d922fedd668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:10.159004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff544-fd97-4819-a836-d922fedd668a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.159289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff544-fd97-4819-a836-d922fedd668a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.159597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff544-fd97-4819-a836-d922fedd668a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.167617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ff544-fd97-4819-a836-d922fedd668a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:10.169596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ff544-fd97-4819-a836-d922fedd668a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-074ff544-fd97-4819-a836-d922fedd668a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:10.203256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:10.204267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:09:10.205212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:10.210998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 380/789] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:10.218968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ff544-fd97-4819-a836-d922fedd668a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:10.223168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:10.252229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85771da-681b-4883-8ec3-86df463eac07 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:10.309733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9940-24fe-4362-bdfa-96dfa48b7770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:10.310922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9940-24fe-4362-bdfa-96dfa48b7770 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.311464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9940-24fe-4362-bdfa-96dfa48b7770 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.312546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9940-24fe-4362-bdfa-96dfa48b7770 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.313416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d9940-24fe-4362-bdfa-96dfa48b7770 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:10.315033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d9940-24fe-4362-bdfa-96dfa48b7770 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-257d9940-24fe-4362-bdfa-96dfa48b7770 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:10.330298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:10.331444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 07 14:09:10.332276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:10.335297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 410/790] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Jun 7 14:09:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:10.341362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9940-24fe-4362-bdfa-96dfa48b7770 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:10.430154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ff544-fd97-4819-a836-d922fedd668a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:10.452523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:10.471242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9940-24fe-4362-bdfa-96dfa48b7770 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:10.504232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b42ed-7761-4103-8bd8-97ea5e919d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:10.505184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b42ed-7761-4103-8bd8-97ea5e919d3f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.505676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b42ed-7761-4103-8bd8-97ea5e919d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.506197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b42ed-7761-4103-8bd8-97ea5e919d3f None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.507248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b42ed-7761-4103-8bd8-97ea5e919d3f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:10.507793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b42ed-7761-4103-8bd8-97ea5e919d3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:10.509419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b42ed-7761-4103-8bd8-97ea5e919d3f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:10.539815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ed43a-fd98-49ab-a741-69bb0cae54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:10.540895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ed43a-fd98-49ab-a741-69bb0cae54ed None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.541385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ed43a-fd98-49ab-a741-69bb0cae54ed None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.541871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ed43a-fd98-49ab-a741-69bb0cae54ed None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.542807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ed43a-fd98-49ab-a741-69bb0cae54ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:10.543466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ed43a-fd98-49ab-a741-69bb0cae54ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:10.545062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ed43a-fd98-49ab-a741-69bb0cae54ed None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:10.545530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 381/791] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jun 7 14:09:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:10.546630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b42ed-7761-4103-8bd8-97ea5e919d3f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:10.554771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 411/792] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jun 7 14:09:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:10.560409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ed43a-fd98-49ab-a741-69bb0cae54ed None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:10.581074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:10.670146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b42ed-7761-4103-8bd8-97ea5e919d3f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:10.698085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ed43a-fd98-49ab-a741-69bb0cae54ed None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:10.709292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fa4e9-c4f4-41ee-9f7a-2861d0ea6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:10.710426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fa4e9-c4f4-41ee-9f7a-2861d0ea6823 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.710931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fa4e9-c4f4-41ee-9f7a-2861d0ea6823 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.711443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fa4e9-c4f4-41ee-9f7a-2861d0ea6823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.723296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fa4e9-c4f4-41ee-9f7a-2861d0ea6823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:10.725143 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fa4e9-c4f4-41ee-9f7a-2861d0ea6823 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:10.735241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2b75b-fc04-45b1-b8c8-fbd68dd35d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:10.736260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b75b-fc04-45b1-b8c8-fbd68dd35d7d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.736373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b75b-fc04-45b1-b8c8-fbd68dd35d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.736579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b75b-fc04-45b1-b8c8-fbd68dd35d7d None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.737297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2b75b-fc04-45b1-b8c8-fbd68dd35d7d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:10.737602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2b75b-fc04-45b1-b8c8-fbd68dd35d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:10.738949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2b75b-fc04-45b1-b8c8-fbd68dd35d7d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-3c0fa4e9-c4f4-41ee-9f7a-2861d0ea6823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:10.746628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:10.747542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:10.748447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:10.748447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:10.748447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:10.748447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:10.749057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 412/793] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jun 7 14:09:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:10.750700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910edb-aa1f-4609-8f1d-27dd3e8c8a5b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.751043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910edb-aa1f-4609-8f1d-27dd3e8c8a5b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.751348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910edb-aa1f-4609-8f1d-27dd3e8c8a5b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.752022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 382/794] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:10.753172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fa4e9-c4f4-41ee-9f7a-2861d0ea6823 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:10.753300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 413/795] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:10.757604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910edb-aa1f-4609-8f1d-27dd3e8c8a5b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:10.777672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:10.845188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:10.866067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fa4e9-c4f4-41ee-9f7a-2861d0ea6823 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:10.870699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910edb-aa1f-4609-8f1d-27dd3e8c8a5b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:10.902000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075755ec-3a4a-4470-9a08-7d637b5c9356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:10.903030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075755ec-3a4a-4470-9a08-7d637b5c9356 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.903549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075755ec-3a4a-4470-9a08-7d637b5c9356 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.904124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075755ec-3a4a-4470-9a08-7d637b5c9356 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.905238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075755ec-3a4a-4470-9a08-7d637b5c9356 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:10.906874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eb462-3c17-4c76-9f62-640ddda11919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:10.907192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075755ec-3a4a-4470-9a08-7d637b5c9356 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:10.907613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb462-3c17-4c76-9f62-640ddda11919 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.907897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb462-3c17-4c76-9f62-640ddda11919 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.908175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eb462-3c17-4c76-9f62-640ddda11919 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.908953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb462-3c17-4c76-9f62-640ddda11919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:10.909259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb462-3c17-4c76-9f62-640ddda11919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:10.910969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eb462-3c17-4c76-9f62-640ddda11919 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:10.926346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 414/796] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:10.928202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e426-361d-4084-a3b0-764240e6e8be None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:10.928897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e426-361d-4084-a3b0-764240e6e8be None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:10.929310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e426-361d-4084-a3b0-764240e6e8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:10.933910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 383/797] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jun 7 14:09:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:09:10.935128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075755ec-3a4a-4470-9a08-7d637b5c9356 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:10.969500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f0b0e426-361d-4084-a3b0-764240e6e8be None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:10.971144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f0b0e426-361d-4084-a3b0-764240e6e8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:11.093660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 415/798] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:11.095500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:11.116765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0e426-361d-4084-a3b0-764240e6e8be None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:11.160429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075755ec-3a4a-4470-9a08-7d637b5c9356 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:11.183731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:11.204666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf42f8-c548-4aa5-a63e-08773e06bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:11.205497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf42f8-c548-4aa5-a63e-08773e06bb36 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:11.205787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf42f8-c548-4aa5-a63e-08773e06bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:11.206064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf42f8-c548-4aa5-a63e-08773e06bb36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:11.220347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf42f8-c548-4aa5-a63e-08773e06bb36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:11.221903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf42f8-c548-4aa5-a63e-08773e06bb36 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-f6bf42f8-c548-4aa5-a63e-08773e06bb36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:11.237708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:11.238654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:11.239745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:11.239745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:11.239745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:11.239745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:11.239745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:11.239745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:11.239745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:11.239745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:11.239745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 384/799] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:11.240780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0e426-361d-4084-a3b0-764240e6e8be None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:11.244579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf42f8-c548-4aa5-a63e-08773e06bb36 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:11.281933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d3b09-9bf4-4268-ad26-ab06afb8b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:11.283019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d3b09-9bf4-4268-ad26-ab06afb8b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:11.283305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d3b09-9bf4-4268-ad26-ab06afb8b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:11.283612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d3b09-9bf4-4268-ad26-ab06afb8b6f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:11.296436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d3b09-9bf4-4268-ad26-ab06afb8b6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-511d3b09-9bf4-4268-ad26-ab06afb8b6f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:11.307250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:11.308458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:11.309653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 416/800] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:09:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:11.318299 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d3b09-9bf4-4268-ad26-ab06afb8b6f5 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:11.379981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf42f8-c548-4aa5-a63e-08773e06bb36 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:11.425371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209653-486b-4260-9b53-250203f2d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:11.426745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209653-486b-4260-9b53-250203f2d9ca None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:11.427252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209653-486b-4260-9b53-250203f2d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:11.428095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30209653-486b-4260-9b53-250203f2d9ca None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:11.429415 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209653-486b-4260-9b53-250203f2d9ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:11.429930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209653-486b-4260-9b53-250203f2d9ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:11.432614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30209653-486b-4260-9b53-250203f2d9ca None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:11.435628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:11.449979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 385/801] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:11.453967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d3b09-9bf4-4268-ad26-ab06afb8b6f5 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:11.455706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209653-486b-4260-9b53-250203f2d9ca None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:11.482017 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:11.497129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d286dfc-3a14-4a92-a5ea-b14fd4b3b2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:11.497824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d286dfc-3a14-4a92-a5ea-b14fd4b3b2ec None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:11.498128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d286dfc-3a14-4a92-a5ea-b14fd4b3b2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:11.498413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d286dfc-3a14-4a92-a5ea-b14fd4b3b2ec None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:11.500213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d286dfc-3a14-4a92-a5ea-b14fd4b3b2ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:11.500535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d286dfc-3a14-4a92-a5ea-b14fd4b3b2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:11.502174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d286dfc-3a14-4a92-a5ea-b14fd4b3b2ec None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:11.514341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 417/802] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:09:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:11.521166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d286dfc-3a14-4a92-a5ea-b14fd4b3b2ec None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:11.631739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30209653-486b-4260-9b53-250203f2d9ca None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:11.645286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d286dfc-3a14-4a92-a5ea-b14fd4b3b2ec None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:11.683378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fee60-0883-4d1f-8eb0-5a0ea6f8cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:11.684297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fee60-0883-4d1f-8eb0-5a0ea6f8cd13 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:11.684680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fee60-0883-4d1f-8eb0-5a0ea6f8cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:11.685065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fee60-0883-4d1f-8eb0-5a0ea6f8cd13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:11.685876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce8ee-93df-4afe-b2a7-959d4ef2b368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:11.686935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce8ee-93df-4afe-b2a7-959d4ef2b368 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:11.687854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce8ee-93df-4afe-b2a7-959d4ef2b368 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:11.688247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ce8ee-93df-4afe-b2a7-959d4ef2b368 None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/ee8475d17d2349559125d2bcd969b9f5/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:11.690348 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ce8ee-93df-4afe-b2a7-959d4ef2b368 None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=ee8475d17d2349559125d2bcd969b9f5, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:11.691923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ce8ee-93df-4afe-b2a7-959d4ef2b368 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:11.699135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fee60-0883-4d1f-8eb0-5a0ea6f8cd13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:11.700862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fee60-0883-4d1f-8eb0-5a0ea6f8cd13 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-112fee60-0883-4d1f-8eb0-5a0ea6f8cd13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:11.721695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:11.722660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:11.723641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:11.723641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:11.723641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:11.723641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:11.726066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 418/803] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:11.731319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fee60-0883-4d1f-8eb0-5a0ea6f8cd13 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:11.732289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 386/804] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:09:11 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/ee8475d17d2349559125d2bcd969b9f5/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:09:11.773172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:11.849113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fee60-0883-4d1f-8eb0-5a0ea6f8cd13 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:11.886216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c00f1-5d9e-4479-aadb-8c41baaa255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:11.886806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c00f1-5d9e-4479-aadb-8c41baaa255e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:11.887092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c00f1-5d9e-4479-aadb-8c41baaa255e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:11.887398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c00f1-5d9e-4479-aadb-8c41baaa255e None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:11.888196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c00f1-5d9e-4479-aadb-8c41baaa255e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:11.888524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c00f1-5d9e-4479-aadb-8c41baaa255e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:11.889936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c00f1-5d9e-4479-aadb-8c41baaa255e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:11.903880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 419/805] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:11.912492 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce8ee-93df-4afe-b2a7-959d4ef2b368 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:11.951241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e688b-4c2b-4cf5-b92b-c30e401f7d67 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:11.951573 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e688b-4c2b-4cf5-b92b-c30e401f7d67 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:11.951861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e688b-4c2b-4cf5-b92b-c30e401f7d67 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:11.953547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 420/806] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:11.959324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15676a-3d69-4eb4-a88c-9fe489ae8a23 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:11.959643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15676a-3d69-4eb4-a88c-9fe489ae8a23 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:11.959926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15676a-3d69-4eb4-a88c-9fe489ae8a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:11.985922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4b15676a-3d69-4eb4-a88c-9fe489ae8a23 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:11.989943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4b15676a-3d69-4eb4-a88c-9fe489ae8a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:12.023040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:12.084535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ce8ee-93df-4afe-b2a7-959d4ef2b368 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:12.105811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 421/807] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:12.127784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d45aa7-eca1-42d2-9f23-c41bc9063e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:12.128776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d45aa7-eca1-42d2-9f23-c41bc9063e45 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:12.129137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d45aa7-eca1-42d2-9f23-c41bc9063e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:12.129504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d45aa7-eca1-42d2-9f23-c41bc9063e45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:12.137333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15676a-3d69-4eb4-a88c-9fe489ae8a23 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:12.138673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d45aa7-eca1-42d2-9f23-c41bc9063e45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:12.140965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d45aa7-eca1-42d2-9f23-c41bc9063e45 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e4d45aa7-eca1-42d2-9f23-c41bc9063e45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:12.161104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:12.162144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:12.163124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 387/808] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:09:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:12.168133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d45aa7-eca1-42d2-9f23-c41bc9063e45 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:12.182907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:12.322845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15676a-3d69-4eb4-a88c-9fe489ae8a23 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:12.377392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c72d54-ca40-4ad4-976a-d9f907bd42d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:12.377637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d45aa7-eca1-42d2-9f23-c41bc9063e45 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:12.378194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c72d54-ca40-4ad4-976a-d9f907bd42d4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:12.378478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c72d54-ca40-4ad4-976a-d9f907bd42d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:12.378755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c72d54-ca40-4ad4-976a-d9f907bd42d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:12.389340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c72d54-ca40-4ad4-976a-d9f907bd42d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d5c72d54-ca40-4ad4-976a-d9f907bd42d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:12.397798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:12.399609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:12.401377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 422/809] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:12.408138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c72d54-ca40-4ad4-976a-d9f907bd42d4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:12.420456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:12.470673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ec6b0-f8d5-4b80-8d39-25fcb215e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:12.471440 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec6b0-f8d5-4b80-8d39-25fcb215e563 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:12.471730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec6b0-f8d5-4b80-8d39-25fcb215e563 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:12.472009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec6b0-f8d5-4b80-8d39-25fcb215e563 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:12.473017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ec6b0-f8d5-4b80-8d39-25fcb215e563 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:12.473333 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ec6b0-f8d5-4b80-8d39-25fcb215e563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:12.474880 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ec6b0-f8d5-4b80-8d39-25fcb215e563 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:12.494109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:12.499809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 388/810] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jun 7 14:09:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:12.502359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ecc57-86db-46f9-a46c-11ff47f5c54a None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:12.502671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ecc57-86db-46f9-a46c-11ff47f5c54a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:12.503027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ecc57-86db-46f9-a46c-11ff47f5c54a None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:12.508923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 389/811] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:12.509480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c72d54-ca40-4ad4-976a-d9f907bd42d4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:12.509735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ecc57-86db-46f9-a46c-11ff47f5c54a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:12.550681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb88e5-53c0-4e83-b830-9141806b245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:12.551367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb88e5-53c0-4e83-b830-9141806b245e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:12.551658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb88e5-53c0-4e83-b830-9141806b245e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:12.551935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb88e5-53c0-4e83-b830-9141806b245e None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:12.552688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb88e5-53c0-4e83-b830-9141806b245e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:12.552995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb88e5-53c0-4e83-b830-9141806b245e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:12.554366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb88e5-53c0-4e83-b830-9141806b245e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:12.563916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 423/812] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:12.565183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aac92-a2f4-4957-885c-ec061619037b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:12.565471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aac92-a2f4-4957-885c-ec061619037b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:12.565748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aac92-a2f4-4957-885c-ec061619037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:12.585560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-318aac92-a2f4-4957-885c-ec061619037b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:12.586805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-318aac92-a2f4-4957-885c-ec061619037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:12.650955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ecc57-86db-46f9-a46c-11ff47f5c54a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:12.661851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 424/813] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:12.663078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aac92-a2f4-4957-885c-ec061619037b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:12.702005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2767-4378-45ff-9ce0-a89590517a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:12.703400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2767-4378-45ff-9ce0-a89590517a90 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:12.703688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2767-4378-45ff-9ce0-a89590517a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:12.703963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2767-4378-45ff-9ce0-a89590517a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:12.714999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f2767-4378-45ff-9ce0-a89590517a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:12.716486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f2767-4378-45ff-9ce0-a89590517a90 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-fa1f2767-4378-45ff-9ce0-a89590517a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:12.734875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:12.735873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:12.736771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:12.736771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:12.736771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:12.736771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:12.736771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 390/814] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:12.737488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2767-4378-45ff-9ce0-a89590517a90 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:12.759407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:12.764103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:12.784065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aac92-a2f4-4957-885c-ec061619037b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:12.820903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbf239-0b74-4b6f-a8b7-5182b21a3500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:12.822125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf239-0b74-4b6f-a8b7-5182b21a3500 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:12.822614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf239-0b74-4b6f-a8b7-5182b21a3500 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:12.823092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf239-0b74-4b6f-a8b7-5182b21a3500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:12.834901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbf239-0b74-4b6f-a8b7-5182b21a3500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:12.836711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbf239-0b74-4b6f-a8b7-5182b21a3500 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:12.842713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2767-4378-45ff-9ce0-a89590517a90 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-85fbf239-0b74-4b6f-a8b7-5182b21a3500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:12.855304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:12.856253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:12.857145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:12.857145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:12.857145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:12.857145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:12.859494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 425/815] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:12.860501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbf239-0b74-4b6f-a8b7-5182b21a3500 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:12.882768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea68de7-45a1-4386-a579-8b468020b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:12.883601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea68de7-45a1-4386-a579-8b468020b011 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:12.883890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea68de7-45a1-4386-a579-8b468020b011 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:12.884182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea68de7-45a1-4386-a579-8b468020b011 None admin] PATH_INFO: `/v3/services/network` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:12.885050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea68de7-45a1-4386-a579-8b468020b011 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:12.886202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea68de7-45a1-4386-a579-8b468020b011 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-eea68de7-45a1-4386-a579-8b468020b011 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:12.898695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:12.899744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 07 14:09:12.900595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:12.904896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 391/816] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:12 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:12.905699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea68de7-45a1-4386-a579-8b468020b011 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:12.972413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbf239-0b74-4b6f-a8b7-5182b21a3500 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.003399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:13.003720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:13.007770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea68de7-45a1-4386-a579-8b468020b011 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.010093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29769c2d-3273-4f73-9c00-f52c074487b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.010989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29769c2d-3273-4f73-9c00-f52c074487b8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.011745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29769c2d-3273-4f73-9c00-f52c074487b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.012269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29769c2d-3273-4f73-9c00-f52c074487b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.014206 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29769c2d-3273-4f73-9c00-f52c074487b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:13.014784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29769c2d-3273-4f73-9c00-f52c074487b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.016408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29769c2d-3273-4f73-9c00-f52c074487b8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.029390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 426/817] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:13.030538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29769c2d-3273-4f73-9c00-f52c074487b8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:13.045005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac898c32-2930-4186-8f19-a9f3c61028ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.045679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac898c32-2930-4186-8f19-a9f3c61028ca None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.045965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac898c32-2930-4186-8f19-a9f3c61028ca None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.046789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac898c32-2930-4186-8f19-a9f3c61028ca None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.047561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac898c32-2930-4186-8f19-a9f3c61028ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:13.047871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac898c32-2930-4186-8f19-a9f3c61028ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.049370 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac898c32-2930-4186-8f19-a9f3c61028ca None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.067190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 392/818] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:13.068403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac898c32-2930-4186-8f19-a9f3c61028ca None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:13.148558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29769c2d-3273-4f73-9c00-f52c074487b8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.176950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac898c32-2930-4186-8f19-a9f3c61028ca None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.185171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62337b22-35f4-4a74-834f-23893b5f2877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.185889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62337b22-35f4-4a74-834f-23893b5f2877 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.186175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62337b22-35f4-4a74-834f-23893b5f2877 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.186484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62337b22-35f4-4a74-834f-23893b5f2877 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.187891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62337b22-35f4-4a74-834f-23893b5f2877 None admin] RBAC: Adding query filter params (name=network) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:13.188213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62337b22-35f4-4a74-834f-23893b5f2877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.189712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62337b22-35f4-4a74-834f-23893b5f2877 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.195392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 427/819] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:13.196244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62337b22-35f4-4a74-834f-23893b5f2877 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:13.218860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61aacd-f92e-40a4-b864-48ea5659f62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.219705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61aacd-f92e-40a4-b864-48ea5659f62a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.220091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61aacd-f92e-40a4-b864-48ea5659f62a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.220372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61aacd-f92e-40a4-b864-48ea5659f62a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.227907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61aacd-f92e-40a4-b864-48ea5659f62a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.229559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61aacd-f92e-40a4-b864-48ea5659f62a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-0b61aacd-f92e-40a4-b864-48ea5659f62a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:13.244979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:13.246011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:13.246906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:13.246906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:13.246906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:13.246906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:13.246906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:13.246906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:13.246906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:13.246906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:13.246906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 393/820] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:13.247895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61aacd-f92e-40a4-b864-48ea5659f62a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:13.266104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:13.272394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:13.325236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62337b22-35f4-4a74-834f-23893b5f2877 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.370587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613d561-5651-4f98-b6d5-0f6576c9f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.371543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613d561-5651-4f98-b6d5-0f6576c9f30d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.371834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613d561-5651-4f98-b6d5-0f6576c9f30d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.372114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613d561-5651-4f98-b6d5-0f6576c9f30d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.383118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613d561-5651-4f98-b6d5-0f6576c9f30d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.385298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613d561-5651-4f98-b6d5-0f6576c9f30d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.386642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61aacd-f92e-40a4-b864-48ea5659f62a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b613d561-5651-4f98-b6d5-0f6576c9f30d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:13.403936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:13.406755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 428/821] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jun 7 14:09:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:13.409145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613d561-5651-4f98-b6d5-0f6576c9f30d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:13.432414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6f0a0-f5b7-4d43-89cb-129b4d6f27e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.433303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6f0a0-f5b7-4d43-89cb-129b4d6f27e4 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.433586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6f0a0-f5b7-4d43-89cb-129b4d6f27e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.433861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6f0a0-f5b7-4d43-89cb-129b4d6f27e4 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.434845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6f0a0-f5b7-4d43-89cb-129b4d6f27e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:13.435561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6f0a0-f5b7-4d43-89cb-129b4d6f27e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.436963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6f0a0-f5b7-4d43-89cb-129b4d6f27e4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.444019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 394/822] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:13.444893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6f0a0-f5b7-4d43-89cb-129b4d6f27e4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:13.548514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:13.568052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613d561-5651-4f98-b6d5-0f6576c9f30d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.588464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:13.591986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6f0a0-f5b7-4d43-89cb-129b4d6f27e4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.616182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ec0c4-c4ce-4c26-a07c-43c417a0cdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.617080 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ec0c4-c4ce-4c26-a07c-43c417a0cdfb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.617541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ec0c4-c4ce-4c26-a07c-43c417a0cdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.618022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ec0c4-c4ce-4c26-a07c-43c417a0cdfb None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.619569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ec0c4-c4ce-4c26-a07c-43c417a0cdfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:13.620062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ec0c4-c4ce-4c26-a07c-43c417a0cdfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.622202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ec0c4-c4ce-4c26-a07c-43c417a0cdfb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.635578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1097cf-fc0d-4579-9aed-32d5e57b2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.636626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1097cf-fc0d-4579-9aed-32d5e57b2a09 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.636986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1097cf-fc0d-4579-9aed-32d5e57b2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.637334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1097cf-fc0d-4579-9aed-32d5e57b2a09 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.638254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1097cf-fc0d-4579-9aed-32d5e57b2a09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:13.638634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1097cf-fc0d-4579-9aed-32d5e57b2a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.639391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 429/823] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:13.640874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ec0c4-c4ce-4c26-a07c-43c417a0cdfb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:13.644740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1097cf-fc0d-4579-9aed-32d5e57b2a09 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.674822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 395/824] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jun 7 14:09:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:13.674822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1097cf-fc0d-4579-9aed-32d5e57b2a09 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:13.781271 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ec0c4-c4ce-4c26-a07c-43c417a0cdfb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.797167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1097cf-fc0d-4579-9aed-32d5e57b2a09 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:13.825125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7821bc-644c-4adc-8dca-c4b70c41666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.825799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7821bc-644c-4adc-8dca-c4b70c41666a None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.826088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7821bc-644c-4adc-8dca-c4b70c41666a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.826402 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7821bc-644c-4adc-8dca-c4b70c41666a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.827114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7821bc-644c-4adc-8dca-c4b70c41666a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.829030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7821bc-644c-4adc-8dca-c4b70c41666a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.832097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:13.839003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c347f-7267-4e0b-8a53-12fb760d5d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:13.839930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c347f-7267-4e0b-8a53-12fb760d5d06 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.840256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c347f-7267-4e0b-8a53-12fb760d5d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.840597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c347f-7267-4e0b-8a53-12fb760d5d06 None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/ff1e9d0a33d54a57af28874b4a57738a/roles/f1f290999a44482b8242439dfe27b3e2` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.851393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 430/825] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jun 7 14:09:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:13.852102 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7821bc-644c-4adc-8dca-c4b70c41666a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:13.867672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c347f-7267-4e0b-8a53-12fb760d5d06 None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=ff1e9d0a33d54a57af28874b4a57738a, role_id=f1f290999a44482b8242439dfe27b3e2)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:13.870520 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c347f-7267-4e0b-8a53-12fb760d5d06 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:13.890603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:13.892334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 396/826] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:09:13 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/ff1e9d0a33d54a57af28874b4a57738a/roles/f1f290999a44482b8242439dfe27b3e2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:09:13.894381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006eacb-0944-4587-81a3-ef09610fd029 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.894928 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006eacb-0944-4587-81a3-ef09610fd029 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.895436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006eacb-0944-4587-81a3-ef09610fd029 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.902809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 397/827] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:13.905044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b394717-c0cd-4da6-b69e-785394b233ea None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:13.908940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b394717-c0cd-4da6-b69e-785394b233ea None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:13.910478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b394717-c0cd-4da6-b69e-785394b233ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:13.936280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1b394717-c0cd-4da6-b69e-785394b233ea None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:13.939598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1b394717-c0cd-4da6-b69e-785394b233ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:14.016393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7821bc-644c-4adc-8dca-c4b70c41666a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:14.081740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2209a-11fb-4834-a3e8-7d6447ab1242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:14.082846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2209a-11fb-4834-a3e8-7d6447ab1242 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.083364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2209a-11fb-4834-a3e8-7d6447ab1242 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.083880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2209a-11fb-4834-a3e8-7d6447ab1242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.097160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 398/828] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:14.144294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b394717-c0cd-4da6-b69e-785394b233ea None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:14.182108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2209a-11fb-4834-a3e8-7d6447ab1242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:14.183696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2209a-11fb-4834-a3e8-7d6447ab1242 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:14.223220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:14.288822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b394717-c0cd-4da6-b69e-785394b233ea None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:14.301044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:14.318045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 431/829] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:09:14.321827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429f4e-4ba2-4d15-a001-90cc832a1576 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.321827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429f4e-4ba2-4d15-a001-90cc832a1576 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.321827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429f4e-4ba2-4d15-a001-90cc832a1576 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.321827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 432/830] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:14.324624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93429f4e-4ba2-4d15-a001-90cc832a1576 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:14.332017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c954668-d35c-47a0-8c61-fca4648b4904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:14.332775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c954668-d35c-47a0-8c61-fca4648b4904 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.333060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c954668-d35c-47a0-8c61-fca4648b4904 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.333335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c954668-d35c-47a0-8c61-fca4648b4904 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.334004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c954668-d35c-47a0-8c61-fca4648b4904 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:14.335846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c954668-d35c-47a0-8c61-fca4648b4904 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-4c954668-d35c-47a0-8c61-fca4648b4904 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:14.349564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:14.350624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:14.352046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 399/831] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:09:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:14.352874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdb687-072b-4280-b42c-7f04416e512a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.352874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdb687-072b-4280-b42c-7f04416e512a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.352874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdb687-072b-4280-b42c-7f04416e512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.371230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b4bdb687-072b-4280-b42c-7f04416e512a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:14.372434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b4bdb687-072b-4280-b42c-7f04416e512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:14.443748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 400/832] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:14.444489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdb687-072b-4280-b42c-7f04416e512a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:14.451605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93429f4e-4ba2-4d15-a001-90cc832a1576 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:14.483751 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:14.493311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6950b-f97a-4c0c-b165-a703314e792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:14.494538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6950b-f97a-4c0c-b165-a703314e792a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.494897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6950b-f97a-4c0c-b165-a703314e792a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.495176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6950b-f97a-4c0c-b165-a703314e792a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.508641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6950b-f97a-4c0c-b165-a703314e792a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:14.510643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6950b-f97a-4c0c-b165-a703314e792a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-fef6950b-f97a-4c0c-b165-a703314e792a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:14.535140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:14.536121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:14.537037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:14.537037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:14.537037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:14.537037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:14.537898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 433/833] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:14.538721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6950b-f97a-4c0c-b165-a703314e792a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:14.561147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdb687-072b-4280-b42c-7f04416e512a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:14.564594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:14.601910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa41f6e-7841-42f7-839d-226fffd654e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:14.603153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa41f6e-7841-42f7-839d-226fffd654e0 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.604062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa41f6e-7841-42f7-839d-226fffd654e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.604809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa41f6e-7841-42f7-839d-226fffd654e0 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.605725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa41f6e-7841-42f7-839d-226fffd654e0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:14.606251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa41f6e-7841-42f7-839d-226fffd654e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:14.608695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa41f6e-7841-42f7-839d-226fffd654e0 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:14.615026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 401/834] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:09:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:14.616075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa41f6e-7841-42f7-839d-226fffd654e0 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:14.644126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6950b-f97a-4c0c-b165-a703314e792a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:14.681567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301da98c-f3e0-4fcd-9d02-3c0ecc045b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:14.682522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301da98c-f3e0-4fcd-9d02-3c0ecc045b89 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.683135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301da98c-f3e0-4fcd-9d02-3c0ecc045b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.683440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301da98c-f3e0-4fcd-9d02-3c0ecc045b89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.694321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301da98c-f3e0-4fcd-9d02-3c0ecc045b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-301da98c-f3e0-4fcd-9d02-3c0ecc045b89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:14.701923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:14.703583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 434/835] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:14.704494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301da98c-f3e0-4fcd-9d02-3c0ecc045b89 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:14.731679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa41f6e-7841-42f7-839d-226fffd654e0 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:14.747775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:14.771190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f56af-c54a-4762-a781-b0b09848e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:14.771889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f56af-c54a-4762-a781-b0b09848e969 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.772170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f56af-c54a-4762-a781-b0b09848e969 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.772448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f56af-c54a-4762-a781-b0b09848e969 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.773169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f56af-c54a-4762-a781-b0b09848e969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:14.773475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f56af-c54a-4762-a781-b0b09848e969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:14.774832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f56af-c54a-4762-a781-b0b09848e969 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:14.786687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 402/836] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:14.788781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f56af-c54a-4762-a781-b0b09848e969 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:14.814367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301da98c-f3e0-4fcd-9d02-3c0ecc045b89 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:14.820590 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:14.850065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388e880-d306-46c5-b64d-765032d9bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:14.850727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388e880-d306-46c5-b64d-765032d9bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.851012 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388e880-d306-46c5-b64d-765032d9bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.851297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388e880-d306-46c5-b64d-765032d9bcf5 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.852104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388e880-d306-46c5-b64d-765032d9bcf5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:14.852357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388e880-d306-46c5-b64d-765032d9bcf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:14.853712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388e880-d306-46c5-b64d-765032d9bcf5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:14.858427 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 435/837] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:09:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:14.859055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388e880-d306-46c5-b64d-765032d9bcf5 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:14.913235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f56af-c54a-4762-a781-b0b09848e969 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:14.952840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe9857-f18b-4cd8-b4f2-82a13df87988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:14.953623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9857-f18b-4cd8-b4f2-82a13df87988 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:14.953909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9857-f18b-4cd8-b4f2-82a13df87988 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:14.954188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe9857-f18b-4cd8-b4f2-82a13df87988 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:14.955020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe9857-f18b-4cd8-b4f2-82a13df87988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:14.955363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe9857-f18b-4cd8-b4f2-82a13df87988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:14.956957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe9857-f18b-4cd8-b4f2-82a13df87988 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:14.967121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 403/838] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:14.973997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388e880-d306-46c5-b64d-765032d9bcf5 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:14.975749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:14.977080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe9857-f18b-4cd8-b4f2-82a13df87988 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:15.024340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b521d-b38a-4444-b204-20a1bd043a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:15.025150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b521d-b38a-4444-b204-20a1bd043a6c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:15.025430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b521d-b38a-4444-b204-20a1bd043a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:15.025700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b521d-b38a-4444-b204-20a1bd043a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:15.035490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b521d-b38a-4444-b204-20a1bd043a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:15.037264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b521d-b38a-4444-b204-20a1bd043a6c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a62b521d-b38a-4444-b204-20a1bd043a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:15.058499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:15.059783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:15.060667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:15.060667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:15.060667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:15.060667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:15.060667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:15.060667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:15.060667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:15.060667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:15.063485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 436/839] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:15.066925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b521d-b38a-4444-b204-20a1bd043a6c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:15.100533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:15.112537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe9857-f18b-4cd8-b4f2-82a13df87988 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:15.158680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e312e6-ba7e-4838-b709-dd4e0e209fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:15.159538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e312e6-ba7e-4838-b709-dd4e0e209fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:15.160341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e312e6-ba7e-4838-b709-dd4e0e209fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:15.160618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e312e6-ba7e-4838-b709-dd4e0e209fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:15.173358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e312e6-ba7e-4838-b709-dd4e0e209fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:15.174961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e312e6-ba7e-4838-b709-dd4e0e209fe8 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:15.187355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b521d-b38a-4444-b204-20a1bd043a6c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-a9e312e6-ba7e-4838-b709-dd4e0e209fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:15.193799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:15.194720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:15.195922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:15.195922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:15.195922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:15.195922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:15.195922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 404/840] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:15.200874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e312e6-ba7e-4838-b709-dd4e0e209fe8 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:15.224942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c1f31-dc76-4795-b7a9-0409e062ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:15.225664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c1f31-dc76-4795-b7a9-0409e062ab19 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:15.225952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c1f31-dc76-4795-b7a9-0409e062ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:15.226235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c1f31-dc76-4795-b7a9-0409e062ab19 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:15.227215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c1f31-dc76-4795-b7a9-0409e062ab19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:15.227578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c1f31-dc76-4795-b7a9-0409e062ab19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:15.229047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c1f31-dc76-4795-b7a9-0409e062ab19 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:15.243258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 437/841] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:15.249963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c1f31-dc76-4795-b7a9-0409e062ab19 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:15.276893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:15.325088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e312e6-ba7e-4838-b709-dd4e0e209fe8 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:15.355640 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c1f31-dc76-4795-b7a9-0409e062ab19 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:15.362240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695afa60-30d8-4344-9476-51f27d69ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:15.363176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695afa60-30d8-4344-9476-51f27d69ac07 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:15.363748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695afa60-30d8-4344-9476-51f27d69ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:15.364242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695afa60-30d8-4344-9476-51f27d69ac07 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:15.365324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695afa60-30d8-4344-9476-51f27d69ac07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:15.365870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695afa60-30d8-4344-9476-51f27d69ac07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:15.367563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695afa60-30d8-4344-9476-51f27d69ac07 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:15.381679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 405/842] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:15.387487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695afa60-30d8-4344-9476-51f27d69ac07 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:15.393103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:15.395247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dd461-526b-45d2-83f0-eb1b88e851d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:15.395930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dd461-526b-45d2-83f0-eb1b88e851d3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:15.396213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dd461-526b-45d2-83f0-eb1b88e851d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:15.396487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70dd461-526b-45d2-83f0-eb1b88e851d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:15.397316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dd461-526b-45d2-83f0-eb1b88e851d3 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=e1ea02cd5e644aaba236acf4e46cb20f) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:15.397628 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dd461-526b-45d2-83f0-eb1b88e851d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:15.399042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70dd461-526b-45d2-83f0-eb1b88e851d3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:15.411803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 438/843] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:15 2022] GET /identity/v3/role_assignments?user.id=e1ea02cd5e644aaba236acf4e46cb20f&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=c6577847f998435991dac5744a94d0ee => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:15.510477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695afa60-30d8-4344-9476-51f27d69ac07 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:15.552407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21dab2-bdd5-45ba-aa19-d8880cd515ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:15.553222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21dab2-bdd5-45ba-aa19-d8880cd515ef None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:15.553506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21dab2-bdd5-45ba-aa19-d8880cd515ef None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:15.553779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21dab2-bdd5-45ba-aa19-d8880cd515ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:15.562414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21dab2-bdd5-45ba-aa19-d8880cd515ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:15.563917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21dab2-bdd5-45ba-aa19-d8880cd515ef None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-ee21dab2-bdd5-45ba-aa19-d8880cd515ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:15.582236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:15.583452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 07 14:09:15.584499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:15.587455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 406/844] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:15.589675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dd461-526b-45d2-83f0-eb1b88e851d3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:15.684243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:15.703798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70dd461-526b-45d2-83f0-eb1b88e851d3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:15.740000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf6f99-84e2-491c-a5e4-f03372671332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:15.740675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf6f99-84e2-491c-a5e4-f03372671332 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:15.740955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf6f99-84e2-491c-a5e4-f03372671332 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:15.741230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf6f99-84e2-491c-a5e4-f03372671332 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:15.742127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf6f99-84e2-491c-a5e4-f03372671332 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:15.742491 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf6f99-84e2-491c-a5e4-f03372671332 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:15.743939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf6f99-84e2-491c-a5e4-f03372671332 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:15.767015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 439/845] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jun 7 14:09:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:15.768457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21dab2-bdd5-45ba-aa19-d8880cd515ef None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:15.834402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:15.874990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21dab2-bdd5-45ba-aa19-d8880cd515ef None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:15.910531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ab6a8-841b-4f9b-82f2-a54630be25f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:15.911180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ab6a8-841b-4f9b-82f2-a54630be25f1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:15.911491 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ab6a8-841b-4f9b-82f2-a54630be25f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:15.911767 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ab6a8-841b-4f9b-82f2-a54630be25f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:15.985771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ab6a8-841b-4f9b-82f2-a54630be25f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:15.987156 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ab6a8-841b-4f9b-82f2-a54630be25f1 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:16.052898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:16.097482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 407/846] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:09:16.103084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf6f99-84e2-491c-a5e4-f03372671332 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:16.207829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf6f99-84e2-491c-a5e4-f03372671332 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:16.244163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfef25-4e5c-44ef-9237-a08ee29e0615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:16.244888 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfef25-4e5c-44ef-9237-a08ee29e0615 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.245153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfef25-4e5c-44ef-9237-a08ee29e0615 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.245425 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfef25-4e5c-44ef-9237-a08ee29e0615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.256241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfef25-4e5c-44ef-9237-a08ee29e0615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:16.257752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfef25-4e5c-44ef-9237-a08ee29e0615 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:16.260345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-81cfef25-4e5c-44ef-9237-a08ee29e0615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:16.277546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:16.279687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:16.282378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:16.282378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:16.282378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:16.282378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:16.283129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 440/847] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:16.285657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfef25-4e5c-44ef-9237-a08ee29e0615 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:16.285797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5496-2834-4de8-9a2a-8b2ad255e1ec None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.285797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5496-2834-4de8-9a2a-8b2ad255e1ec None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.291381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c5496-2834-4de8-9a2a-8b2ad255e1ec None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.291381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 408/848] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:16.293001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b68da-5ecd-4077-8254-0c0272a3fbc6 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.293498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b68da-5ecd-4077-8254-0c0272a3fbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.293998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b68da-5ecd-4077-8254-0c0272a3fbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.312113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-885b68da-5ecd-4077-8254-0c0272a3fbc6 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:16.313734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-885b68da-5ecd-4077-8254-0c0272a3fbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:16.389029 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfef25-4e5c-44ef-9237-a08ee29e0615 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:16.399427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 409/849] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:16.418261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b68da-5ecd-4077-8254-0c0272a3fbc6 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:16.432031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678576-6766-4dca-87d9-e9c39790745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:16.432691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678576-6766-4dca-87d9-e9c39790745f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.432977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678576-6766-4dca-87d9-e9c39790745f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.433250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678576-6766-4dca-87d9-e9c39790745f None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.434085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8678576-6766-4dca-87d9-e9c39790745f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:16.434385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8678576-6766-4dca-87d9-e9c39790745f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:16.435914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8678576-6766-4dca-87d9-e9c39790745f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:16.454359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 441/850] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:16.455683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678576-6766-4dca-87d9-e9c39790745f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:16.523868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:16.525114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:16.535107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b68da-5ecd-4077-8254-0c0272a3fbc6 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:16.570715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56f7dc-e31b-4172-a3ae-6991930d970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:16.570950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678576-6766-4dca-87d9-e9c39790745f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:16.571785 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56f7dc-e31b-4172-a3ae-6991930d970f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.572169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56f7dc-e31b-4172-a3ae-6991930d970f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.572567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56f7dc-e31b-4172-a3ae-6991930d970f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.584269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56f7dc-e31b-4172-a3ae-6991930d970f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-8b56f7dc-e31b-4172-a3ae-6991930d970f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:16.592723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:16.593899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:09:16.594780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:16.595562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 410/851] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:09:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:16.604470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56f7dc-e31b-4172-a3ae-6991930d970f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:16.612868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f63a37-123b-4f88-b95e-fea1d09f562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:16.613677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f63a37-123b-4f88-b95e-fea1d09f562f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.613962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f63a37-123b-4f88-b95e-fea1d09f562f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.614236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f63a37-123b-4f88-b95e-fea1d09f562f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.622910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f63a37-123b-4f88-b95e-fea1d09f562f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:16.625324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f63a37-123b-4f88-b95e-fea1d09f562f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-10f63a37-123b-4f88-b95e-fea1d09f562f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:16.644165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:16.645134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:16.646058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:16.646058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:16.646058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:16.646058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:16.646058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:16.646058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:16.646058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:16.646058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:16.646058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 442/852] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:16.651120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f63a37-123b-4f88-b95e-fea1d09f562f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:16.726184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56f7dc-e31b-4172-a3ae-6991930d970f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:16.761327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f63a37-123b-4f88-b95e-fea1d09f562f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:16.765529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58f305-9dd5-4a2b-9301-e3566fdbfdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:16.766508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58f305-9dd5-4a2b-9301-e3566fdbfdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.767018 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58f305-9dd5-4a2b-9301-e3566fdbfdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.767582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58f305-9dd5-4a2b-9301-e3566fdbfdf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.768568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58f305-9dd5-4a2b-9301-e3566fdbfdf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:16.769196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58f305-9dd5-4a2b-9301-e3566fdbfdf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:16.770876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58f305-9dd5-4a2b-9301-e3566fdbfdf4 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:16.778675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:16.785891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 411/853] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:09:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:16.787868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58f305-9dd5-4a2b-9301-e3566fdbfdf4 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:16.799478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c04d-3e1c-4bba-a225-6cae2ecfdc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:16.800195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c04d-3e1c-4bba-a225-6cae2ecfdc46 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.800475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c04d-3e1c-4bba-a225-6cae2ecfdc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.800746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84c04d-3e1c-4bba-a225-6cae2ecfdc46 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.801880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84c04d-3e1c-4bba-a225-6cae2ecfdc46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:16.801993 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84c04d-3e1c-4bba-a225-6cae2ecfdc46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:16.803644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84c04d-3e1c-4bba-a225-6cae2ecfdc46 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:16.807755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:16.823261 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 443/854] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:16.824747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c04d-3e1c-4bba-a225-6cae2ecfdc46 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:16.899824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58f305-9dd5-4a2b-9301-e3566fdbfdf4 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:16.934637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84c04d-3e1c-4bba-a225-6cae2ecfdc46 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:16.941244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9bbcc-5344-41b0-a545-5ec903916dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:16.942390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9bbcc-5344-41b0-a545-5ec903916dca None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.942881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9bbcc-5344-41b0-a545-5ec903916dca None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.943365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9bbcc-5344-41b0-a545-5ec903916dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.956245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9bbcc-5344-41b0-a545-5ec903916dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:16.958117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e9bbcc-5344-41b0-a545-5ec903916dca None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:16.972651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff212ae-68e4-4c2c-afa4-3c86d524b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:16.973306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff212ae-68e4-4c2c-afa4-3c86d524b1ab None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:16.973586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff212ae-68e4-4c2c-afa4-3c86d524b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:16.973861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff212ae-68e4-4c2c-afa4-3c86d524b1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:16.974690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff212ae-68e4-4c2c-afa4-3c86d524b1ab None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=ee8475d17d2349559125d2bcd969b9f5) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:16.974999 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff212ae-68e4-4c2c-afa4-3c86d524b1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:16.976486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff212ae-68e4-4c2c-afa4-3c86d524b1ab None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-16e9bbcc-5344-41b0-a545-5ec903916dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:16.978778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:16.979683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:16.980578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:16.980578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:16.980578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:16.980578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:16.987837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 444/856] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:16 2022] GET /identity/v3/role_assignments?user.id=ee8475d17d2349559125d2bcd969b9f5&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=c6577847f998435991dac5744a94d0ee => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:16.988149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 412/856] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:16.988748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff212ae-68e4-4c2c-afa4-3c86d524b1ab None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:17.040962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:17.107397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff212ae-68e4-4c2c-afa4-3c86d524b1ab None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:17.145532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95634d80-84fe-4b6f-83a5-7430537622cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:17.146616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95634d80-84fe-4b6f-83a5-7430537622cd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:17.147109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95634d80-84fe-4b6f-83a5-7430537622cd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:17.147636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95634d80-84fe-4b6f-83a5-7430537622cd None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:17.148650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95634d80-84fe-4b6f-83a5-7430537622cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:17.149243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95634d80-84fe-4b6f-83a5-7430537622cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:17.150859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95634d80-84fe-4b6f-83a5-7430537622cd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:17.165529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 445/857] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:17.172140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9bbcc-5344-41b0-a545-5ec903916dca None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:17.246602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:17.263596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70bf3-1abd-4f1b-850c-916d7e99f9d5 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:17.263891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70bf3-1abd-4f1b-850c-916d7e99f9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:17.264176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70bf3-1abd-4f1b-850c-916d7e99f9d5 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:17.265575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 446/858] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:17.273482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b7d4-9754-4e69-843e-75c3af190563 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:17.273482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b7d4-9754-4e69-843e-75c3af190563 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:17.273482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b7d4-9754-4e69-843e-75c3af190563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:17.292254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9bbcc-5344-41b0-a545-5ec903916dca None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:17.293168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9d50b7d4-9754-4e69-843e-75c3af190563 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:17.295321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9d50b7d4-9754-4e69-843e-75c3af190563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:17.329692 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9bad8-115f-4126-baf6-4bfa34ea00d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:17.330510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9bad8-115f-4126-baf6-4bfa34ea00d1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:17.330790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9bad8-115f-4126-baf6-4bfa34ea00d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:17.331119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9bad8-115f-4126-baf6-4bfa34ea00d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:17.339530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9bad8-115f-4126-baf6-4bfa34ea00d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:17.340970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9bad8-115f-4126-baf6-4bfa34ea00d1 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-94d9bad8-115f-4126-baf6-4bfa34ea00d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:17.356946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:17.357944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:17.359593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 413/859] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:09:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:17.367119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9bad8-115f-4126-baf6-4bfa34ea00d1 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:17.381358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 447/860] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:17.404768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b7d4-9754-4e69-843e-75c3af190563 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:17.436860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:17.512527 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9bad8-115f-4126-baf6-4bfa34ea00d1 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:17.528353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b7d4-9754-4e69-843e-75c3af190563 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:17.542191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:17.552845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681c5bc-4a2c-484a-b1fb-e82063b4e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:17.553772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681c5bc-4a2c-484a-b1fb-e82063b4e2ae None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:17.554247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681c5bc-4a2c-484a-b1fb-e82063b4e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:17.554715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681c5bc-4a2c-484a-b1fb-e82063b4e2ae None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:17.556093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681c5bc-4a2c-484a-b1fb-e82063b4e2ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:17.556874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681c5bc-4a2c-484a-b1fb-e82063b4e2ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:17.559624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681c5bc-4a2c-484a-b1fb-e82063b4e2ae None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:17.575090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c12d2-769d-4899-9947-16d9fe844969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:17.575778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c12d2-769d-4899-9947-16d9fe844969 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:17.576065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c12d2-769d-4899-9947-16d9fe844969 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:17.576346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c12d2-769d-4899-9947-16d9fe844969 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:17.577597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c12d2-769d-4899-9947-16d9fe844969 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:17.579786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c12d2-769d-4899-9947-16d9fe844969 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:17.586969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 414/861] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jun 7 14:09:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:17.588266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681c5bc-4a2c-484a-b1fb-e82063b4e2ae None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:17.603361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 448/862] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:09:17 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:09:17.711190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681c5bc-4a2c-484a-b1fb-e82063b4e2ae None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:17.760693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b38b7-0235-4b0d-8a93-c0ff5e50a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:17.761824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b38b7-0235-4b0d-8a93-c0ff5e50a80b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:17.762317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b38b7-0235-4b0d-8a93-c0ff5e50a80b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:17.762797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b38b7-0235-4b0d-8a93-c0ff5e50a80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:17.819371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:17.837780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e241-c344-4bf5-813c-659489179db5 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:17.838311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e241-c344-4bf5-813c-659489179db5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:17.838413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e241-c344-4bf5-813c-659489179db5 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:17.839803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 449/863] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:17.845740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766ba1-5776-49fd-bfa7-98e3382d01a1 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:17.846030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766ba1-5776-49fd-bfa7-98e3382d01a1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:17.846816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766ba1-5776-49fd-bfa7-98e3382d01a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:17.848498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b38b7-0235-4b0d-8a93-c0ff5e50a80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:17.849911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b38b7-0235-4b0d-8a93-c0ff5e50a80b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:17.866964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f3766ba1-5776-49fd-bfa7-98e3382d01a1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:17.868222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f3766ba1-5776-49fd-bfa7-98e3382d01a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:17.959784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 415/864] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:17 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:09:17.962253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 450/865] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:17.967386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b38b7-0235-4b0d-8a93-c0ff5e50a80b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:17.985645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766ba1-5776-49fd-bfa7-98e3382d01a1 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:18.007752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:18.054667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:18.077866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b38b7-0235-4b0d-8a93-c0ff5e50a80b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:18.095404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766ba1-5776-49fd-bfa7-98e3382d01a1 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:18.112615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d5711-59db-4069-803e-7f382f0cf17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:18.113416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d5711-59db-4069-803e-7f382f0cf17a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:18.113756 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d5711-59db-4069-803e-7f382f0cf17a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:18.114034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d5711-59db-4069-803e-7f382f0cf17a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:18.125052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d5711-59db-4069-803e-7f382f0cf17a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:18.126500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d5711-59db-4069-803e-7f382f0cf17a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:18.133230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba647-1f40-4f24-aea8-2788d0108fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:18.134362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba647-1f40-4f24-aea8-2788d0108fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:18.134857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba647-1f40-4f24-aea8-2788d0108fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:18.135391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba647-1f40-4f24-aea8-2788d0108fa0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:18.136284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba647-1f40-4f24-aea8-2788d0108fa0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:18.137867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba647-1f40-4f24-aea8-2788d0108fa0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-559d5711-59db-4069-803e-7f382f0cf17a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:18.145927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:18.146786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:18.148052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:18.148052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:18.148052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:18.148052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:18.151879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 416/866] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:18.152707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d5711-59db-4069-803e-7f382f0cf17a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e95ba647-1f40-4f24-aea8-2788d0108fa0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:18.154342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:18.155318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:09:18.156226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:18.163537 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 451/867] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Jun 7 14:09:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:18.168208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba647-1f40-4f24-aea8-2788d0108fa0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:18.273851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:18.276280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d5711-59db-4069-803e-7f382f0cf17a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:18.292996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba647-1f40-4f24-aea8-2788d0108fa0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:18.321727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420aac-3e65-4a55-aa10-4cc9724d9bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:18.322394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420aac-3e65-4a55-aa10-4cc9724d9bcd None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:18.322928 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420aac-3e65-4a55-aa10-4cc9724d9bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:18.323217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15420aac-3e65-4a55-aa10-4cc9724d9bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:18.324568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420aac-3e65-4a55-aa10-4cc9724d9bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:18.324884 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420aac-3e65-4a55-aa10-4cc9724d9bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:18.326509 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15420aac-3e65-4a55-aa10-4cc9724d9bcd None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:18.332794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1039a-f23f-4cbb-8794-8cb70234907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:18.333713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1039a-f23f-4cbb-8794-8cb70234907a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:18.334226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1039a-f23f-4cbb-8794-8cb70234907a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:18.334574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1039a-f23f-4cbb-8794-8cb70234907a None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:18.335401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1039a-f23f-4cbb-8794-8cb70234907a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:18.335961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1039a-f23f-4cbb-8794-8cb70234907a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:18.337388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1039a-f23f-4cbb-8794-8cb70234907a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:18.342326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:18.345652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 417/868] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:18.346539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420aac-3e65-4a55-aa10-4cc9724d9bcd None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:18.347085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 452/869] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:18.348070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1039a-f23f-4cbb-8794-8cb70234907a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:18.458473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1039a-f23f-4cbb-8794-8cb70234907a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:18.487919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15420aac-3e65-4a55-aa10-4cc9724d9bcd None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:18.501542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a08b-030d-4220-bc31-44611a2918b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:18.502513 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a08b-030d-4220-bc31-44611a2918b2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:18.503027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a08b-030d-4220-bc31-44611a2918b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:18.503540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885a08b-030d-4220-bc31-44611a2918b2 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:18.504469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885a08b-030d-4220-bc31-44611a2918b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:18.504979 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885a08b-030d-4220-bc31-44611a2918b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:18.506540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885a08b-030d-4220-bc31-44611a2918b2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:18.511889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 453/870] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:18.536201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe07a7-3399-4576-a891-148d9c068806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:18.537455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe07a7-3399-4576-a891-148d9c068806 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:18.537957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe07a7-3399-4576-a891-148d9c068806 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:18.538433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe07a7-3399-4576-a891-148d9c068806 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:18.547220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe07a7-3399-4576-a891-148d9c068806 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:18.549102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe07a7-3399-4576-a891-148d9c068806 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-7afe07a7-3399-4576-a891-148d9c068806 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:18.565215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:18.566201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:18.567127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:18.567127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:18.567127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:18.567127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:18.567127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:18.567127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:18.567127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:18.567127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:18.569234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 418/871] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:18.575420 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a08b-030d-4220-bc31-44611a2918b2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:18.594490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:18.690979 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885a08b-030d-4220-bc31-44611a2918b2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:18.729281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316016e-e66e-4821-9768-b00cb1746d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:18.729956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316016e-e66e-4821-9768-b00cb1746d58 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:18.730240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316016e-e66e-4821-9768-b00cb1746d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:18.730520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316016e-e66e-4821-9768-b00cb1746d58 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:18.731318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316016e-e66e-4821-9768-b00cb1746d58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:18.731660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316016e-e66e-4821-9768-b00cb1746d58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:18.733679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316016e-e66e-4821-9768-b00cb1746d58 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:18.748434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 454/872] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:18.754775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe07a7-3399-4576-a891-148d9c068806 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:18.813070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:18.864765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe07a7-3399-4576-a891-148d9c068806 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:18.900459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad4b74-e703-4079-903d-f527ea2a1ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:18.901136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad4b74-e703-4079-903d-f527ea2a1ead None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:18.901421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad4b74-e703-4079-903d-f527ea2a1ead None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:18.901696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad4b74-e703-4079-903d-f527ea2a1ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:18.902544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad4b74-e703-4079-903d-f527ea2a1ead None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=ff1e9d0a33d54a57af28874b4a57738a) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:18.902858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad4b74-e703-4079-903d-f527ea2a1ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:18.904330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad4b74-e703-4079-903d-f527ea2a1ead None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:18.911876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 419/873] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:18 2022] GET /identity/v3/role_assignments?user.id=ff1e9d0a33d54a57af28874b4a57738a&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:19.394838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7d825-09d9-45a5-bcdd-131f86161256 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:19.395407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7d825-09d9-45a5-bcdd-131f86161256 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:19.395407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7d825-09d9-45a5-bcdd-131f86161256 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:19.397022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 455/874] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:19.402329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aca43-4ccb-4c00-b71e-283c32d32c40 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:19.402728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aca43-4ccb-4c00-b71e-283c32d32c40 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:19.402892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aca43-4ccb-4c00-b71e-283c32d32c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:19.419983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b05aca43-4ccb-4c00-b71e-283c32d32c40 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:19.421754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b05aca43-4ccb-4c00-b71e-283c32d32c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:19.497090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 420/875] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:19.511139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7d825-09d9-45a5-bcdd-131f86161256 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:19.585050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:19.617118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7d825-09d9-45a5-bcdd-131f86161256 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:19.651953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750321-d51e-4f1e-a36b-c0e5cd20cd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:19.652683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750321-d51e-4f1e-a36b-c0e5cd20cd48 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:19.652964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750321-d51e-4f1e-a36b-c0e5cd20cd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:19.653242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750321-d51e-4f1e-a36b-c0e5cd20cd48 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:19.653898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1750321-d51e-4f1e-a36b-c0e5cd20cd48 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:19.655866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1750321-d51e-4f1e-a36b-c0e5cd20cd48 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-c1750321-d51e-4f1e-a36b-c0e5cd20cd48 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:19.668535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:19.669626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:19.670512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 456/876] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:19.676353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aca43-4ccb-4c00-b71e-283c32d32c40 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:19.735052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:19.790783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05aca43-4ccb-4c00-b71e-283c32d32c40 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:19.827317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fa820-5ac0-49fd-a254-b0a384588d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:19.828416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fa820-5ac0-49fd-a254-b0a384588d86 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:19.828903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fa820-5ac0-49fd-a254-b0a384588d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:19.829394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fa820-5ac0-49fd-a254-b0a384588d86 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:19.830303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fa820-5ac0-49fd-a254-b0a384588d86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:19.830870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fa820-5ac0-49fd-a254-b0a384588d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:19.832541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fa820-5ac0-49fd-a254-b0a384588d86 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:19.838070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 421/877] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:19.843591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750321-d51e-4f1e-a36b-c0e5cd20cd48 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:19.953498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750321-d51e-4f1e-a36b-c0e5cd20cd48 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:19.988297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef6a5e-fcae-4790-919d-8e7d36306eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:19.988976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef6a5e-fcae-4790-919d-8e7d36306eba None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:19.989265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef6a5e-fcae-4790-919d-8e7d36306eba None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:19.989542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef6a5e-fcae-4790-919d-8e7d36306eba None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:19.990251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef6a5e-fcae-4790-919d-8e7d36306eba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:19.990557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef6a5e-fcae-4790-919d-8e7d36306eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:19.991946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef6a5e-fcae-4790-919d-8e7d36306eba None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:19.994015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:19.997434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 457/878] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:20.022110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baea54d-67a8-4cc1-987f-10b16e80d8eb None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:20.022413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baea54d-67a8-4cc1-987f-10b16e80d8eb None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:20.022683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baea54d-67a8-4cc1-987f-10b16e80d8eb None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:20.024460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 422/879] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:20.030903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10fa2-b9e7-4cfd-92ca-548d1ce18e55 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:20.031226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10fa2-b9e7-4cfd-92ca-548d1ce18e55 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:20.031554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10fa2-b9e7-4cfd-92ca-548d1ce18e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:20.050785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-65e10fa2-b9e7-4cfd-92ca-548d1ce18e55 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:20.052027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-65e10fa2-b9e7-4cfd-92ca-548d1ce18e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:20.134109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 458/880] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:20.157746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baea54d-67a8-4cc1-987f-10b16e80d8eb None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:20.270149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baea54d-67a8-4cc1-987f-10b16e80d8eb None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:20.282144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:20.307047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c651f92-4127-4142-add1-f68b7fa8fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:20.307890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c651f92-4127-4142-add1-f68b7fa8fa65 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:20.308176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c651f92-4127-4142-add1-f68b7fa8fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:20.308511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c651f92-4127-4142-add1-f68b7fa8fa65 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:20.309183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c651f92-4127-4142-add1-f68b7fa8fa65 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:20.310604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c651f92-4127-4142-add1-f68b7fa8fa65 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-2c651f92-4127-4142-add1-f68b7fa8fa65 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:20.323206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:20.324265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:20.325108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 423/881] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:09:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:20.332663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e10fa2-b9e7-4cfd-92ca-548d1ce18e55 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:20.436215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e10fa2-b9e7-4cfd-92ca-548d1ce18e55 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:20.466641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:20.473345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b18229-9676-4184-85d6-68cf1d7fba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:20.474089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b18229-9676-4184-85d6-68cf1d7fba62 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:20.474446 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b18229-9676-4184-85d6-68cf1d7fba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:20.474795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b18229-9676-4184-85d6-68cf1d7fba62 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:20.475626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b18229-9676-4184-85d6-68cf1d7fba62 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:20.475937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b18229-9676-4184-85d6-68cf1d7fba62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:20.477311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b18229-9676-4184-85d6-68cf1d7fba62 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:20.488148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 459/882] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:09:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:20.495909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c651f92-4127-4142-add1-f68b7fa8fa65 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:20.609220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c651f92-4127-4142-add1-f68b7fa8fa65 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:20.643323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007fb1-f903-4599-878b-9d8e228f712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:20.644013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007fb1-f903-4599-878b-9d8e228f712e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:20.644297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007fb1-f903-4599-878b-9d8e228f712e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:20.644571 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007fb1-f903-4599-878b-9d8e228f712e None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:20.645281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007fb1-f903-4599-878b-9d8e228f712e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:20.645582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007fb1-f903-4599-878b-9d8e228f712e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:20.646932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007fb1-f903-4599-878b-9d8e228f712e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:20.652367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 424/883] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:09:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:20.658659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b18229-9676-4184-85d6-68cf1d7fba62 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:20.766180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b18229-9676-4184-85d6-68cf1d7fba62 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:20.801997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752f9ac-b888-41d6-994e-86d03a4e5a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:20.802664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f9ac-b888-41d6-994e-86d03a4e5a03 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:20.802949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f9ac-b888-41d6-994e-86d03a4e5a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:20.803227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f9ac-b888-41d6-994e-86d03a4e5a03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:20.804055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752f9ac-b888-41d6-994e-86d03a4e5a03 None admin] RBAC: Adding query filter params (interface=public, service_id=10713587f63d45aebe1360c530f5871a, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:20.804366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752f9ac-b888-41d6-994e-86d03a4e5a03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:20.805727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752f9ac-b888-41d6-994e-86d03a4e5a03 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:20.811969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 460/884] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jun 7 14:09:20 2022] GET /identity/v3/endpoints?service_id=10713587f63d45aebe1360c530f5871a&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:20.817345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007fb1-f903-4599-878b-9d8e228f712e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:20.861708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:20.886857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20d0ab-c2f6-4c65-8195-aada0add5ce1 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:20.887175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20d0ab-c2f6-4c65-8195-aada0add5ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:20.887460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20d0ab-c2f6-4c65-8195-aada0add5ce1 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:20.889105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 461/885] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:20.894822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087aef2-d4b5-45ae-ace0-91e45cb874d6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:20.895113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087aef2-d4b5-45ae-ace0-91e45cb874d6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:20.895432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087aef2-d4b5-45ae-ace0-91e45cb874d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:20.914830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d087aef2-d4b5-45ae-ace0-91e45cb874d6 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:20.916222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d087aef2-d4b5-45ae-ace0-91e45cb874d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:20.925069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007fb1-f903-4599-878b-9d8e228f712e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:20.969228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64cfb3-79f4-41b0-8956-ae70f268d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:20.969895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64cfb3-79f4-41b0-8956-ae70f268d31b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:20.970173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64cfb3-79f4-41b0-8956-ae70f268d31b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:20.970445 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64cfb3-79f4-41b0-8956-ae70f268d31b None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:20.971123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64cfb3-79f4-41b0-8956-ae70f268d31b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:20.972526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64cfb3-79f4-41b0-8956-ae70f268d31b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:20.978404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 425/886] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jun 7 14:09:20 2022] GET /identity/v3/services => generated 1011 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:09:20.989101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:21.010050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 462/887] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:21.035415 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64cfb3-79f4-41b0-8956-ae70f268d31b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:21.151168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64cfb3-79f4-41b0-8956-ae70f268d31b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:21.152879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:21.189644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985fd0b-10e0-4c27-a822-009cc41a5bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:21.190332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985fd0b-10e0-4c27-a822-009cc41a5bcd None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:21.190611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985fd0b-10e0-4c27-a822-009cc41a5bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:21.190883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985fd0b-10e0-4c27-a822-009cc41a5bcd None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:21.191696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985fd0b-10e0-4c27-a822-009cc41a5bcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:21.193089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985fd0b-10e0-4c27-a822-009cc41a5bcd None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:21.210622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 426/888] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:09:21 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:21.410458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b920d4-72f1-485c-97c8-0124390869b6 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:21.410819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b920d4-72f1-485c-97c8-0124390869b6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:21.410925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b920d4-72f1-485c-97c8-0124390869b6 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:21.412554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 463/889] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:21.418064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ec7e-bade-44d1-a9b4-85dc1a99bb3d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:21.418362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ec7e-bade-44d1-a9b4-85dc1a99bb3d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:21.418645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9ec7e-bade-44d1-a9b4-85dc1a99bb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:21.437549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-18a9ec7e-bade-44d1-a9b4-85dc1a99bb3d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:21.439018 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-18a9ec7e-bade-44d1-a9b4-85dc1a99bb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:21.527016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 427/890] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:21.551495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b920d4-72f1-485c-97c8-0124390869b6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:21.661928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b920d4-72f1-485c-97c8-0124390869b6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:21.698259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22e3a-b0f0-4e2c-922f-96418fe0dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:21.699081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22e3a-b0f0-4e2c-922f-96418fe0dd5d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:21.699388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22e3a-b0f0-4e2c-922f-96418fe0dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:21.699675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22e3a-b0f0-4e2c-922f-96418fe0dd5d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:21.710826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d22e3a-b0f0-4e2c-922f-96418fe0dd5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b7d22e3a-b0f0-4e2c-922f-96418fe0dd5d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:21.719867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:21.720785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:21.722512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 464/891] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jun 7 14:09:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:21.727304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ec7e-bade-44d1-a9b4-85dc1a99bb3d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:21.820646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:21.835434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9ec7e-bade-44d1-a9b4-85dc1a99bb3d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:21.876373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8df95-b00d-448d-bd52-6ccbec215a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:21.877052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8df95-b00d-448d-bd52-6ccbec215a62 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:21.877341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8df95-b00d-448d-bd52-6ccbec215a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:21.877619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8df95-b00d-448d-bd52-6ccbec215a62 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:21.878380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8df95-b00d-448d-bd52-6ccbec215a62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:21.878685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8df95-b00d-448d-bd52-6ccbec215a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:21.880098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8df95-b00d-448d-bd52-6ccbec215a62 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:21.888939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 428/892] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jun 7 14:09:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:21.894762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22e3a-b0f0-4e2c-922f-96418fe0dd5d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:21.947398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:22.004710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22e3a-b0f0-4e2c-922f-96418fe0dd5d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:22.045058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45623d-2a85-480b-a55b-145ccc4a71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:22.045898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45623d-2a85-480b-a55b-145ccc4a71c6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:22.046185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45623d-2a85-480b-a55b-145ccc4a71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:22.046468 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45623d-2a85-480b-a55b-145ccc4a71c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:22.057846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45623d-2a85-480b-a55b-145ccc4a71c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:22.059305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45623d-2a85-480b-a55b-145ccc4a71c6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-7e45623d-2a85-480b-a55b-145ccc4a71c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:22.077727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:22.079836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:22.082002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:22.082002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:22.082002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:22.082002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:22.082002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 465/893] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:22.084800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8df95-b00d-448d-bd52-6ccbec215a62 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:22.190152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8df95-b00d-448d-bd52-6ccbec215a62 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:22.236534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7b2ed-7b2f-41f7-bec5-0c133218092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:22.237128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7b2ed-7b2f-41f7-bec5-0c133218092e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:22.237469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7b2ed-7b2f-41f7-bec5-0c133218092e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:22.237755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7b2ed-7b2f-41f7-bec5-0c133218092e None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:22.238490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7b2ed-7b2f-41f7-bec5-0c133218092e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:22.238798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7b2ed-7b2f-41f7-bec5-0c133218092e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:22.240198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7b2ed-7b2f-41f7-bec5-0c133218092e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:22.253013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 429/894] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:22.258501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45623d-2a85-480b-a55b-145ccc4a71c6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:22.351472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d760a3-2efe-445a-8d08-26078225478c None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:22.351834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d760a3-2efe-445a-8d08-26078225478c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:22.352030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d760a3-2efe-445a-8d08-26078225478c None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:22.353748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 430/895] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:22.359233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd9ae4-526c-4887-8a60-10f72aa55f12 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:22.359666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd9ae4-526c-4887-8a60-10f72aa55f12 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:22.359949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd9ae4-526c-4887-8a60-10f72aa55f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:22.363856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:22.368733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45623d-2a85-480b-a55b-145ccc4a71c6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:22.381872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-c8fd9ae4-526c-4887-8a60-10f72aa55f12 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:22.383746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c8fd9ae4-526c-4887-8a60-10f72aa55f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:22.389137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:22.413104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64989f5-54cb-44df-9620-4001e5703da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:22.413950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64989f5-54cb-44df-9620-4001e5703da4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:22.414243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64989f5-54cb-44df-9620-4001e5703da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:22.414521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64989f5-54cb-44df-9620-4001e5703da4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:22.423416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64989f5-54cb-44df-9620-4001e5703da4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:22.424872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64989f5-54cb-44df-9620-4001e5703da4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-c64989f5-54cb-44df-9620-4001e5703da4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:22.441562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:22.444351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:22.447140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 466/896] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:09:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:22.449392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64989f5-54cb-44df-9620-4001e5703da4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:22.467096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 431/897] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:22.489274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd9ae4-526c-4887-8a60-10f72aa55f12 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:22.574709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64989f5-54cb-44df-9620-4001e5703da4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:22.599735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd9ae4-526c-4887-8a60-10f72aa55f12 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:22.613106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38ed0-c3cf-4a6a-a816-e6c4a40a8715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:22.613784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38ed0-c3cf-4a6a-a816-e6c4a40a8715 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:22.614071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38ed0-c3cf-4a6a-a816-e6c4a40a8715 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:22.614351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d38ed0-c3cf-4a6a-a816-e6c4a40a8715 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:22.615393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d38ed0-c3cf-4a6a-a816-e6c4a40a8715 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:22.616078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d38ed0-c3cf-4a6a-a816-e6c4a40a8715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:22.617799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d38ed0-c3cf-4a6a-a816-e6c4a40a8715 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:22.640684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cfa39-60c9-4848-9a1c-e4052fdf567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:22.641419 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 467/898] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jun 7 14:09:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:22.641566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cfa39-60c9-4848-9a1c-e4052fdf567d None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:22.641907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cfa39-60c9-4848-9a1c-e4052fdf567d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:22.642250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cfa39-60c9-4848-9a1c-e4052fdf567d None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:22.643041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cfa39-60c9-4848-9a1c-e4052fdf567d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:22.647533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3cfa39-60c9-4848-9a1c-e4052fdf567d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:22.647749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38ed0-c3cf-4a6a-a816-e6c4a40a8715 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:22.660378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:22.676025 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 432/899] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:09:22 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:09:22.676223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:22.768241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d38ed0-c3cf-4a6a-a816-e6c4a40a8715 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:22.818806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0f757-e6d0-4a6a-af63-22b5327bc3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:22.820164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0f757-e6d0-4a6a-af63-22b5327bc3be None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:22.820657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0f757-e6d0-4a6a-af63-22b5327bc3be None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:22.821155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0f757-e6d0-4a6a-af63-22b5327bc3be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:22.896587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0f757-e6d0-4a6a-af63-22b5327bc3be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:22.898409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0f757-e6d0-4a6a-af63-22b5327bc3be None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:22.914412 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:23.005608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 468/900] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:22 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:09:23.011059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cfa39-60c9-4848-9a1c-e4052fdf567d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:23.124023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cfa39-60c9-4848-9a1c-e4052fdf567d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:23.159091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb0281-ac26-46ac-b64d-dbfc23b51524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:23.159936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb0281-ac26-46ac-b64d-dbfc23b51524 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.160220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb0281-ac26-46ac-b64d-dbfc23b51524 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.160501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb0281-ac26-46ac-b64d-dbfc23b51524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.171725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb0281-ac26-46ac-b64d-dbfc23b51524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:23.173179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb0281-ac26-46ac-b64d-dbfc23b51524 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-0fdb0281-ac26-46ac-b64d-dbfc23b51524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:23.190843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:23.191778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:23.192677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:23.192677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:23.192677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:23.192677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:23.192677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 433/901] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:23.200633 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0f757-e6d0-4a6a-af63-22b5327bc3be None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:23.316673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0f757-e6d0-4a6a-af63-22b5327bc3be None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:23.332306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:23.354473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8555-e9c9-46b3-9e55-2e1d1f46ed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:23.355518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8555-e9c9-46b3-9e55-2e1d1f46ed8f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.355989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8555-e9c9-46b3-9e55-2e1d1f46ed8f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.356528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8555-e9c9-46b3-9e55-2e1d1f46ed8f None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.357455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8555-e9c9-46b3-9e55-2e1d1f46ed8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:23.358500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8555-e9c9-46b3-9e55-2e1d1f46ed8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:23.360065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8555-e9c9-46b3-9e55-2e1d1f46ed8f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:23.372563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 469/902] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:23.378387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb0281-ac26-46ac-b64d-dbfc23b51524 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:23.420121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664fb91-6df5-43fc-98b7-dcd6837731fc None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.420426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664fb91-6df5-43fc-98b7-dcd6837731fc None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.420718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664fb91-6df5-43fc-98b7-dcd6837731fc None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.422336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 470/903] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:23.427262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a55c-4ffc-4366-b99f-866037354768 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.427590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a55c-4ffc-4366-b99f-866037354768 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.427873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a55c-4ffc-4366-b99f-866037354768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.438749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:23.446335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-58d3a55c-4ffc-4366-b99f-866037354768 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:23.447712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-58d3a55c-4ffc-4366-b99f-866037354768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:23.504401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb0281-ac26-46ac-b64d-dbfc23b51524 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:23.535852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 471/904] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:23.545183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af2dfa-7509-494c-9e13-5b36feb5bf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:23.546259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af2dfa-7509-494c-9e13-5b36feb5bf68 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.546727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af2dfa-7509-494c-9e13-5b36feb5bf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.547210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af2dfa-7509-494c-9e13-5b36feb5bf68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.552234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3a55c-4ffc-4366-b99f-866037354768 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:23.556197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af2dfa-7509-494c-9e13-5b36feb5bf68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:23.557841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af2dfa-7509-494c-9e13-5b36feb5bf68 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-02af2dfa-7509-494c-9e13-5b36feb5bf68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:23.576992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:23.578100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:23.579224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:23.579224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:23.579224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:23.579224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:23.579224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:23.579224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:23.579224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:23.579224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:23.585401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 434/905] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:23.585401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c649-6559-4327-841f-c794ea390ace None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.585401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c649-6559-4327-841f-c794ea390ace None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.585401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c649-6559-4327-841f-c794ea390ace None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.585401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 435/906] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:23.588648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c649-6559-4327-841f-c794ea390ace None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:23.663494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3a55c-4ffc-4366-b99f-866037354768 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:23.666709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:23.700486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bad53-3b7b-47c3-b845-67f3a1bb31bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:23.701281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bad53-3b7b-47c3-b845-67f3a1bb31bb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.702073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bad53-3b7b-47c3-b845-67f3a1bb31bb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.702349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bad53-3b7b-47c3-b845-67f3a1bb31bb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.703002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bad53-3b7b-47c3-b845-67f3a1bb31bb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:23.703166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c649-6559-4327-841f-c794ea390ace None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:23.704392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bad53-3b7b-47c3-b845-67f3a1bb31bb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a92bad53-3b7b-47c3-b845-67f3a1bb31bb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:23.716381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:23.717985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:23.718842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 472/907] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:09:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:23.720311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729641fe-379a-476d-bcb1-019fee891ee3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.720311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729641fe-379a-476d-bcb1-019fee891ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.720311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729641fe-379a-476d-bcb1-019fee891ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.720925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:23.740582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-729641fe-379a-476d-bcb1-019fee891ee3 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:23.741775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-729641fe-379a-476d-bcb1-019fee891ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:23.748311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf4e43-ebce-49fd-991c-4b4337ecffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:23.748982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf4e43-ebce-49fd-991c-4b4337ecffab None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.749253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf4e43-ebce-49fd-991c-4b4337ecffab None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.749528 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf4e43-ebce-49fd-991c-4b4337ecffab None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.750314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf4e43-ebce-49fd-991c-4b4337ecffab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:23.750622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf4e43-ebce-49fd-991c-4b4337ecffab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:23.752063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf4e43-ebce-49fd-991c-4b4337ecffab None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:23.769533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 436/908] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:23.769533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf4e43-ebce-49fd-991c-4b4337ecffab None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:23.817983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 473/909] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:23.819021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729641fe-379a-476d-bcb1-019fee891ee3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:23.886286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf4e43-ebce-49fd-991c-4b4337ecffab None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:23.919700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:23.924240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729641fe-379a-476d-bcb1-019fee891ee3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:23.927040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f75cf-e233-4482-8ca0-923ab3339b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:23.927770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f75cf-e233-4482-8ca0-923ab3339b21 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.928060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f75cf-e233-4482-8ca0-923ab3339b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.928339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f75cf-e233-4482-8ca0-923ab3339b21 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.929076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f75cf-e233-4482-8ca0-923ab3339b21 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:23.929386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f75cf-e233-4482-8ca0-923ab3339b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:23.930813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f75cf-e233-4482-8ca0-923ab3339b21 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:23.941320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 437/910] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:09:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:23.941320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f75cf-e233-4482-8ca0-923ab3339b21 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:23.967679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd709e4e-0bdc-43f1-a3af-e8dc6d46f22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:23.968401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd709e4e-0bdc-43f1-a3af-e8dc6d46f22c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:23.968613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd709e4e-0bdc-43f1-a3af-e8dc6d46f22c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:23.968876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd709e4e-0bdc-43f1-a3af-e8dc6d46f22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:23.969759 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd709e4e-0bdc-43f1-a3af-e8dc6d46f22c None admin] RBAC: Adding query filter params (role.id=a2fad9c023754ad5b921d75bf26d9efc, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=ff1e9d0a33d54a57af28874b4a57738a) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:23.970011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd709e4e-0bdc-43f1-a3af-e8dc6d46f22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:23.971443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd709e4e-0bdc-43f1-a3af-e8dc6d46f22c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:23.987366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 474/911] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:23 2022] GET /identity/v3/role_assignments?user.id=ff1e9d0a33d54a57af28874b4a57738a&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=a2fad9c023754ad5b921d75bf26d9efc => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:23.987366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd709e4e-0bdc-43f1-a3af-e8dc6d46f22c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:23.989956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:24.052528 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f75cf-e233-4482-8ca0-923ab3339b21 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:24.091309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fb93f-90e7-4be0-9087-380794c26941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:24.092345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fb93f-90e7-4be0-9087-380794c26941 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:24.092709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fb93f-90e7-4be0-9087-380794c26941 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:24.093077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fb93f-90e7-4be0-9087-380794c26941 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:24.093821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fb93f-90e7-4be0-9087-380794c26941 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:24.095275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fb93f-90e7-4be0-9087-380794c26941 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e59fb93f-90e7-4be0-9087-380794c26941 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:24.108533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:24.109552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:09:24.110404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:24.115322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 438/912] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Jun 7 14:09:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:24.117759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fb93f-90e7-4be0-9087-380794c26941 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:24.132361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd709e4e-0bdc-43f1-a3af-e8dc6d46f22c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:24.184899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a4552-838a-49bd-bb70-72b3a7a99278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:24.186262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a4552-838a-49bd-bb70-72b3a7a99278 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:24.186703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a4552-838a-49bd-bb70-72b3a7a99278 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:24.187052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a4552-838a-49bd-bb70-72b3a7a99278 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:24.187898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a4552-838a-49bd-bb70-72b3a7a99278 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:24.188275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a4552-838a-49bd-bb70-72b3a7a99278 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:24.189958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a4552-838a-49bd-bb70-72b3a7a99278 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:24.197247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 475/913] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jun 7 14:09:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:24.202198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a4552-838a-49bd-bb70-72b3a7a99278 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:24.238619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:24.242557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fb93f-90e7-4be0-9087-380794c26941 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:24.243426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:24.279029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9fed2-97f6-4d03-b50a-c192b8ac1777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:24.280046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9fed2-97f6-4d03-b50a-c192b8ac1777 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:24.280509 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9fed2-97f6-4d03-b50a-c192b8ac1777 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:24.280964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9fed2-97f6-4d03-b50a-c192b8ac1777 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:24.281870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9fed2-97f6-4d03-b50a-c192b8ac1777 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:24.282350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9fed2-97f6-4d03-b50a-c192b8ac1777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:24.283911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9fed2-97f6-4d03-b50a-c192b8ac1777 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:24.289264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 439/914] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:24.294513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9fed2-97f6-4d03-b50a-c192b8ac1777 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:24.328729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a4552-838a-49bd-bb70-72b3a7a99278 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:24.367185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241889a4-e0d8-4e76-96e7-d2e6931093ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:24.368225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241889a4-e0d8-4e76-96e7-d2e6931093ef None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:24.368699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241889a4-e0d8-4e76-96e7-d2e6931093ef None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:24.369208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241889a4-e0d8-4e76-96e7-d2e6931093ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:24.370176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241889a4-e0d8-4e76-96e7-d2e6931093ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:24.371952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241889a4-e0d8-4e76-96e7-d2e6931093ef None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:24.399674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 476/915] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jun 7 14:09:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:24.404494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9fed2-97f6-4d03-b50a-c192b8ac1777 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:24.452588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b394-d8f4-4345-bf18-46fcc2f83789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:24.453202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b394-d8f4-4345-bf18-46fcc2f83789 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:24.453466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b394-d8f4-4345-bf18-46fcc2f83789 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:24.453747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b394-d8f4-4345-bf18-46fcc2f83789 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:24.454466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851b394-d8f4-4345-bf18-46fcc2f83789 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:24.454777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851b394-d8f4-4345-bf18-46fcc2f83789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:24.456208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851b394-d8f4-4345-bf18-46fcc2f83789 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:24.462538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 440/916] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:24.468713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241889a4-e0d8-4e76-96e7-d2e6931093ef None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:24.572985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:24.594658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241889a4-e0d8-4e76-96e7-d2e6931093ef None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:24.631414 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e24fa5-c94b-4a55-92b8-2b3978e1ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:24.632084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24fa5-c94b-4a55-92b8-2b3978e1ca2e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:24.632367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24fa5-c94b-4a55-92b8-2b3978e1ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:24.632644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24fa5-c94b-4a55-92b8-2b3978e1ca2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:24.633440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e24fa5-c94b-4a55-92b8-2b3978e1ca2e None admin] RBAC: Adding query filter params (interface=public, service_id=bb01b7ad15f94933aa56c56df6e176ba, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:24.633753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e24fa5-c94b-4a55-92b8-2b3978e1ca2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:24.635112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e24fa5-c94b-4a55-92b8-2b3978e1ca2e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:24.640944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 477/917] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jun 7 14:09:24 2022] GET /identity/v3/endpoints?service_id=bb01b7ad15f94933aa56c56df6e176ba&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:24.646392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b394-d8f4-4345-bf18-46fcc2f83789 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:24.673850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:24.752246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b394-d8f4-4345-bf18-46fcc2f83789 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:24.791962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a2795-7ccb-44a5-99a9-f2a4d99289e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:24.793007 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2795-7ccb-44a5-99a9-f2a4d99289e0 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:24.793529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2795-7ccb-44a5-99a9-f2a4d99289e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:24.794017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a2795-7ccb-44a5-99a9-f2a4d99289e0 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:24.795004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a2795-7ccb-44a5-99a9-f2a4d99289e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:24.797118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a2795-7ccb-44a5-99a9-f2a4d99289e0 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:24.804310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 441/918] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jun 7 14:09:24 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:09:25.104824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b7b0-f33c-44e9-94a9-a6b24e5450c5 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:25.105315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b7b0-f33c-44e9-94a9-a6b24e5450c5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:25.105315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b7b0-f33c-44e9-94a9-a6b24e5450c5 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:25.106794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 478/919] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:25.113393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff802f6-baf1-4306-bd63-39932a12044f None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:25.113922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff802f6-baf1-4306-bd63-39932a12044f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:25.114440 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff802f6-baf1-4306-bd63-39932a12044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:25.131788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-dff802f6-baf1-4306-bd63-39932a12044f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:25.133294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-dff802f6-baf1-4306-bd63-39932a12044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:25.206190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 442/920] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:25.229857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639b7b0-f33c-44e9-94a9-a6b24e5450c5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:25.336331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639b7b0-f33c-44e9-94a9-a6b24e5450c5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:25.371530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d553b44-dea5-43d2-a7a2-d76aaf4292e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:25.372282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d553b44-dea5-43d2-a7a2-d76aaf4292e1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:25.372569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d553b44-dea5-43d2-a7a2-d76aaf4292e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:25.372850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d553b44-dea5-43d2-a7a2-d76aaf4292e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:25.374169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d553b44-dea5-43d2-a7a2-d76aaf4292e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:25.375768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d553b44-dea5-43d2-a7a2-d76aaf4292e1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6d553b44-dea5-43d2-a7a2-d76aaf4292e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:25.388222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:25.389842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:25.390858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:25.394949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 479/921] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:25.401073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff802f6-baf1-4306-bd63-39932a12044f None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:25.424233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:25.505375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff802f6-baf1-4306-bd63-39932a12044f None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:25.541352 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02498-b5d3-4a7d-b238-6da003c8f226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:25.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02498-b5d3-4a7d-b238-6da003c8f226 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:25.542915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02498-b5d3-4a7d-b238-6da003c8f226 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:25.543414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d02498-b5d3-4a7d-b238-6da003c8f226 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:25.544330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d02498-b5d3-4a7d-b238-6da003c8f226 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:25.544840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d02498-b5d3-4a7d-b238-6da003c8f226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:25.546459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d02498-b5d3-4a7d-b238-6da003c8f226 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:25.552072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 443/922] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:25.561614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d553b44-dea5-43d2-a7a2-d76aaf4292e1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:25.578589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:25.681305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d553b44-dea5-43d2-a7a2-d76aaf4292e1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:25.719101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7aad0-9485-4d0d-b105-24ec593b9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:25.719807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7aad0-9485-4d0d-b105-24ec593b9600 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:25.720109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7aad0-9485-4d0d-b105-24ec593b9600 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:25.720369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7aad0-9485-4d0d-b105-24ec593b9600 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:25.721090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7aad0-9485-4d0d-b105-24ec593b9600 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:25.721402 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7aad0-9485-4d0d-b105-24ec593b9600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:25.722772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7aad0-9485-4d0d-b105-24ec593b9600 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:25.728542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 480/923] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:25.735194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02498-b5d3-4a7d-b238-6da003c8f226 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:25.824569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:25.844725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d02498-b5d3-4a7d-b238-6da003c8f226 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:25.889753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34665cbb-5215-4093-804e-994c2fe71986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:25.890413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665cbb-5215-4093-804e-994c2fe71986 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:25.890694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665cbb-5215-4093-804e-994c2fe71986 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:25.890968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34665cbb-5215-4093-804e-994c2fe71986 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:25.891785 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34665cbb-5215-4093-804e-994c2fe71986 None admin] RBAC: Adding query filter params (interface=public, service_id=f22d551bbc514b7cb35a408abd4946e7, region_id=RegionOne) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:25.892094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34665cbb-5215-4093-804e-994c2fe71986 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:25.893451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34665cbb-5215-4093-804e-994c2fe71986 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:25.901553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 444/924] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jun 7 14:09:25 2022] GET /identity/v3/endpoints?service_id=f22d551bbc514b7cb35a408abd4946e7&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:25.906817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7aad0-9485-4d0d-b105-24ec593b9600 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:25.991186 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:26.017990 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7aad0-9485-4d0d-b105-24ec593b9600 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:26.056939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72d5f8-b1d9-4bc2-be32-ed599b32b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:26.057630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72d5f8-b1d9-4bc2-be32-ed599b32b770 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:26.057915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72d5f8-b1d9-4bc2-be32-ed599b32b770 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:26.058196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72d5f8-b1d9-4bc2-be32-ed599b32b770 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:26.058903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72d5f8-b1d9-4bc2-be32-ed599b32b770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:26.060351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72d5f8-b1d9-4bc2-be32-ed599b32b770 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:26.068014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 481/925] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jun 7 14:09:25 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:09:26.414827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f7236-88d7-472f-b252-d3de0ef0ba42 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:26.415140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f7236-88d7-472f-b252-d3de0ef0ba42 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:26.415460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f7236-88d7-472f-b252-d3de0ef0ba42 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:26.417105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 445/926] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:26.422814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9269f6-7256-48bb-a87e-a1cb6ba57240 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:26.423250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9269f6-7256-48bb-a87e-a1cb6ba57240 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:26.423458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9269f6-7256-48bb-a87e-a1cb6ba57240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:26.441157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2d9269f6-7256-48bb-a87e-a1cb6ba57240 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:26.442344 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2d9269f6-7256-48bb-a87e-a1cb6ba57240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:26.519448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 482/927] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:26.534943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f7236-88d7-472f-b252-d3de0ef0ba42 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:26.651016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f7236-88d7-472f-b252-d3de0ef0ba42 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:26.687586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec799c-1303-4cc6-9e37-271e41dd2b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:26.688334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec799c-1303-4cc6-9e37-271e41dd2b1a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:26.688619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec799c-1303-4cc6-9e37-271e41dd2b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:26.688901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec799c-1303-4cc6-9e37-271e41dd2b1a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:26.700330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec799c-1303-4cc6-9e37-271e41dd2b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-0cec799c-1303-4cc6-9e37-271e41dd2b1a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:26.708781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:26.709720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:26.710562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 446/928] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jun 7 14:09:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:26.716103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9269f6-7256-48bb-a87e-a1cb6ba57240 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:26.785390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:26.820069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9269f6-7256-48bb-a87e-a1cb6ba57240 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:26.855194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c548dc-e168-49fa-b450-34c691ed752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:26.856066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c548dc-e168-49fa-b450-34c691ed752c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:26.856352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c548dc-e168-49fa-b450-34c691ed752c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:26.856630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c548dc-e168-49fa-b450-34c691ed752c None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:26.857383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c548dc-e168-49fa-b450-34c691ed752c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:26.858258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c548dc-e168-49fa-b450-34c691ed752c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:26.859629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c548dc-e168-49fa-b450-34c691ed752c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:26.872836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 483/929] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jun 7 14:09:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:26.876427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec799c-1303-4cc6-9e37-271e41dd2b1a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:26.886140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:26.894817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e15e0-dab3-4e76-9755-e4f192f772c6 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:26.895159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e15e0-dab3-4e76-9755-e4f192f772c6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:26.895405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e15e0-dab3-4e76-9755-e4f192f772c6 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:26.897361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 484/930] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:26.902936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9251ae1-c07e-4186-aa75-c2e0da849b5d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:26.903277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9251ae1-c07e-4186-aa75-c2e0da849b5d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:26.903535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9251ae1-c07e-4186-aa75-c2e0da849b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:26.923189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c9251ae1-c07e-4186-aa75-c2e0da849b5d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:26.924433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c9251ae1-c07e-4186-aa75-c2e0da849b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:26.993022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec799c-1303-4cc6-9e37-271e41dd2b1a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:26.996255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 485/931] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:27.018779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9251ae1-c07e-4186-aa75-c2e0da849b5d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.038266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa72a-c224-4c6a-bc0a-75acd577a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.039057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa72a-c224-4c6a-bc0a-75acd577a722 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.039358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa72a-c224-4c6a-bc0a-75acd577a722 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.039626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fa72a-c224-4c6a-bc0a-75acd577a722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.051473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4fa72a-c224-4c6a-bc0a-75acd577a722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.053053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4fa72a-c224-4c6a-bc0a-75acd577a722 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-3a4fa72a-c224-4c6a-bc0a-75acd577a722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:27.072244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:27.073170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:27.074056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:27.074056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:27.074056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:27.074056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:27.078160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 447/932] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:27.079541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa72a-c224-4c6a-bc0a-75acd577a722 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.083193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:27.126035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9251ae1-c07e-4186-aa75-c2e0da849b5d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:27.145491 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:27.162632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.163670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.164174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.164650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.165553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.167208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.168814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING keystone.server.flask.common [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 07 14:09:27.187792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.sql.core [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 14:09:27.187792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 07 14:09:27.187792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [parameters: {'id': 'cafa1b0d255e4fdeb34bb3a0b4c76093', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 07 14:09:27.187792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80293) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 14:09:27.191556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fa72a-c224-4c6a-bc0a-75acd577a722 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cafa1b0d255e4fdeb34bb3a0b4c76093.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cafa1b0d255e4fdeb34bb3a0b4c76093. Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:09:27.196836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application result.read() Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 07 14:09:27.197635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application yield resource Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise self.value Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application session.commit() Jun 07 14:09:27.198629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.session.flush() Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application compat.raise_( Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 14:09:27.199566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 14:09:27.200600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application result.read() Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:09:27.201966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [parameters: {'id': 'cafa1b0d255e4fdeb34bb3a0b4c76093', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.202843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:27.205160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:27.207352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:27.207352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 07 14:09:27.207352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 07 14:09:27.207352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:27.207352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:27.207352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 07 14:09:27.207352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 07 14:09:27.207352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cafa1b0d255e4fdeb34bb3a0b4c76093. Jun 07 14:09:27.207352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.215022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 486/933] 10.222.0.77 () {60 vars in 1140 bytes} [Tue Jun 7 14:09:27 2022] POST /identity/v3/projects => generated 262 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:27.216557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.230902 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640afcac-72c2-4d0c-b112-6f8f36a94b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.232024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afcac-72c2-4d0c-b112-6f8f36a94b9b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.232024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afcac-72c2-4d0c-b112-6f8f36a94b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.232322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640afcac-72c2-4d0c-b112-6f8f36a94b9b None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.233084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640afcac-72c2-4d0c-b112-6f8f36a94b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:27.233435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640afcac-72c2-4d0c-b112-6f8f36a94b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.234991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640afcac-72c2-4d0c-b112-6f8f36a94b9b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.249136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 448/934] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:27.250623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31250af1-8d9c-427b-9ba6-211ac0724492 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.250915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31250af1-8d9c-427b-9ba6-211ac0724492 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.251191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31250af1-8d9c-427b-9ba6-211ac0724492 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.252799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 449/935] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:27.257780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ca6fb-84e7-46e5-b212-7834ff2af564 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.258078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ca6fb-84e7-46e5-b212-7834ff2af564 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.258360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ca6fb-84e7-46e5-b212-7834ff2af564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.276598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-f69ca6fb-84e7-46e5-b212-7834ff2af564 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:27.277795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f69ca6fb-84e7-46e5-b212-7834ff2af564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:27.329401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62698707-8e91-4b27-b0f4-91b33f0947e9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:27.347003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:27.359501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 450/936] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:27.360768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ca6fb-84e7-46e5-b212-7834ff2af564 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.370375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8ad2c-362e-4fcd-aefc-998e15b3f601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.371182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ad2c-362e-4fcd-aefc-998e15b3f601 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.371535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ad2c-362e-4fcd-aefc-998e15b3f601 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.371814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ad2c-362e-4fcd-aefc-998e15b3f601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.379043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8ad2c-362e-4fcd-aefc-998e15b3f601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.380747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8ad2c-362e-4fcd-aefc-998e15b3f601 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f5a8ad2c-362e-4fcd-aefc-998e15b3f601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:27.396636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:27.397575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:27.398477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:27.398477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:27.398477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:27.398477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:27.398477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:27.398477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:27.398477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:27.398477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.398477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 487/937] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:27.398978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8ad2c-362e-4fcd-aefc-998e15b3f601 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.423997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:27.477486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ca6fb-84e7-46e5-b212-7834ff2af564 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:27.511229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8ad2c-362e-4fcd-aefc-998e15b3f601 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:27.516483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48527-c72d-43f5-a36b-15183e26dde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.517308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48527-c72d-43f5-a36b-15183e26dde3 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.517596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48527-c72d-43f5-a36b-15183e26dde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.517875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48527-c72d-43f5-a36b-15183e26dde3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.525108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a48527-c72d-43f5-a36b-15183e26dde3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.526550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a48527-c72d-43f5-a36b-15183e26dde3 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-98a48527-c72d-43f5-a36b-15183e26dde3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:27.542428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:27.543401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:27.544350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 451/938] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:27.544938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48527-c72d-43f5-a36b-15183e26dde3 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.551795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd3653-2b81-4e4f-b532-99b92521e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.552621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd3653-2b81-4e4f-b532-99b92521e837 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.552908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd3653-2b81-4e4f-b532-99b92521e837 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.553189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd3653-2b81-4e4f-b532-99b92521e837 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.553849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd3653-2b81-4e4f-b532-99b92521e837 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.555207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd3653-2b81-4e4f-b532-99b92521e837 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6afd3653-2b81-4e4f-b532-99b92521e837 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:27.568157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:27.569077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.570198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 488/939] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:27.571949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd3653-2b81-4e4f-b532-99b92521e837 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.617504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:27.655743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48527-c72d-43f5-a36b-15183e26dde3 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:27.665853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:27.684181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd3653-2b81-4e4f-b532-99b92521e837 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:27.691790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ca44b-ca62-4851-8424-750f575013b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.692796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ca44b-ca62-4851-8424-750f575013b7 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.692796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ca44b-ca62-4851-8424-750f575013b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.693032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ca44b-ca62-4851-8424-750f575013b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.693738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ca44b-ca62-4851-8424-750f575013b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:27.694260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ca44b-ca62-4851-8424-750f575013b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.695723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ca44b-ca62-4851-8424-750f575013b7 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.713706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 452/940] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:27.714802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ca44b-ca62-4851-8424-750f575013b7 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.737399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade925fe-3d01-48dd-b5a3-7741371d21df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.738093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade925fe-3d01-48dd-b5a3-7741371d21df None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.738376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade925fe-3d01-48dd-b5a3-7741371d21df None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.738649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade925fe-3d01-48dd-b5a3-7741371d21df None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.739547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade925fe-3d01-48dd-b5a3-7741371d21df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:27.739858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade925fe-3d01-48dd-b5a3-7741371d21df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.741329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade925fe-3d01-48dd-b5a3-7741371d21df None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.766666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 489/941] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:27.772305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade925fe-3d01-48dd-b5a3-7741371d21df None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.884055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:27.888528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade925fe-3d01-48dd-b5a3-7741371d21df None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:27.891969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ca44b-ca62-4851-8424-750f575013b7 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:27.930194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce51ad5-613c-4a74-9330-db35328b4ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.931154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce51ad5-613c-4a74-9330-db35328b4ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.931481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce51ad5-613c-4a74-9330-db35328b4ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.931758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce51ad5-613c-4a74-9330-db35328b4ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.943701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd068eea-1559-4434-8ecd-ff6114d5ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:27.944253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce51ad5-613c-4a74-9330-db35328b4ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.945231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd068eea-1559-4434-8ecd-ff6114d5ca52 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:27.945719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd068eea-1559-4434-8ecd-ff6114d5ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:27.945954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce51ad5-613c-4a74-9330-db35328b4ee5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.946203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd068eea-1559-4434-8ecd-ff6114d5ca52 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:27.946929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd068eea-1559-4434-8ecd-ff6114d5ca52 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:27.947239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd068eea-1559-4434-8ecd-ff6114d5ca52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:27.948633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd068eea-1559-4434-8ecd-ff6114d5ca52 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:27.955172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 453/942] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:27.962065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd068eea-1559-4434-8ecd-ff6114d5ca52 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6ce51ad5-613c-4a74-9330-db35328b4ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:27.969236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:27.970153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:27.971051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:27.971051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:27.971051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:27.971051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:27.973995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 490/943] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:27.976335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce51ad5-613c-4a74-9330-db35328b4ee5 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:28.001384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:28.093509 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd068eea-1559-4434-8ecd-ff6114d5ca52 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:28.110831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce51ad5-613c-4a74-9330-db35328b4ee5 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:28.136559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9da8fe-fcbb-4c78-a1c1-57c2c85573c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:28.137235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9da8fe-fcbb-4c78-a1c1-57c2c85573c8 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.137787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9da8fe-fcbb-4c78-a1c1-57c2c85573c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.138065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9da8fe-fcbb-4c78-a1c1-57c2c85573c8 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.138807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9da8fe-fcbb-4c78-a1c1-57c2c85573c8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:28.139256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9da8fe-fcbb-4c78-a1c1-57c2c85573c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:28.141241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9da8fe-fcbb-4c78-a1c1-57c2c85573c8 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:28.148076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 454/944] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:28.154286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9da8fe-fcbb-4c78-a1c1-57c2c85573c8 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:28.158629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f0a9c-8056-41c3-a775-a7feb1252445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:28.159302 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0a9c-8056-41c3-a775-a7feb1252445 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.159621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0a9c-8056-41c3-a775-a7feb1252445 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.160771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f0a9c-8056-41c3-a775-a7feb1252445 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.161521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f0a9c-8056-41c3-a775-a7feb1252445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:28.161837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f0a9c-8056-41c3-a775-a7feb1252445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:28.163210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f0a9c-8056-41c3-a775-a7feb1252445 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:28.182359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 491/945] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:28.183964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f0a9c-8056-41c3-a775-a7feb1252445 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:28.215735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:28.261944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:28.269247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9da8fe-fcbb-4c78-a1c1-57c2c85573c8 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:28.296189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f0a9c-8056-41c3-a775-a7feb1252445 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:28.305583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6822ba-cd73-47b6-bec8-2141e08854a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:28.306253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6822ba-cd73-47b6-bec8-2141e08854a0 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.306537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6822ba-cd73-47b6-bec8-2141e08854a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.306813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6822ba-cd73-47b6-bec8-2141e08854a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.307795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6822ba-cd73-47b6-bec8-2141e08854a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:28.309118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6822ba-cd73-47b6-bec8-2141e08854a0 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:28.339371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 455/946] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jun 7 14:09:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:28.353398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcb721-ce50-45ae-86fb-12218398ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:28.354138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcb721-ce50-45ae-86fb-12218398ca42 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.354423 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcb721-ce50-45ae-86fb-12218398ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.354800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcb721-ce50-45ae-86fb-12218398ca42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.363741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcb721-ce50-45ae-86fb-12218398ca42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:28.365249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcb721-ce50-45ae-86fb-12218398ca42 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:28.379878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00db2c-07de-4dd6-8388-05387098d2e2 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.380196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00db2c-07de-4dd6-8388-05387098d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.380444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00db2c-07de-4dd6-8388-05387098d2e2 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-08dcb721-ce50-45ae-86fb-12218398ca42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:28.383550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:28.384461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:28.385341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:28.385341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:28.385341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:28.385341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:28.385341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:28.385341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:28.385341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:28.385341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:28.385341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 492/947] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:28.386275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 456/948] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:28.387295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050e0c4-c3c7-4ad1-a6bb-90481c1804a5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.387633 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050e0c4-c3c7-4ad1-a6bb-90481c1804a5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.387913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050e0c4-c3c7-4ad1-a6bb-90481c1804a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.390645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00db2c-07de-4dd6-8388-05387098d2e2 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:28.408613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a050e0c4-c3c7-4ad1-a6bb-90481c1804a5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:28.410229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a050e0c4-c3c7-4ad1-a6bb-90481c1804a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:28.494082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:28.508387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 493/949] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:28.526387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00db2c-07de-4dd6-8388-05387098d2e2 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:28.531738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050e0c4-c3c7-4ad1-a6bb-90481c1804a5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:28.575647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6a27f-dacd-45d5-932c-51042af858aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:28.576337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6a27f-dacd-45d5-932c-51042af858aa None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.576869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6a27f-dacd-45d5-932c-51042af858aa None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.576869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6a27f-dacd-45d5-932c-51042af858aa None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.577740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6a27f-dacd-45d5-932c-51042af858aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:28.578039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6a27f-dacd-45d5-932c-51042af858aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:28.580309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6a27f-dacd-45d5-932c-51042af858aa None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:28.593615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 457/950] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:28.599276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6a27f-dacd-45d5-932c-51042af858aa None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:28.620372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:28.654359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050e0c4-c3c7-4ad1-a6bb-90481c1804a5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:28.692348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1fafc-9803-4746-98b2-136fe7f6fe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:28.693297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1fafc-9803-4746-98b2-136fe7f6fe4d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.693684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1fafc-9803-4746-98b2-136fe7f6fe4d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.694025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1fafc-9803-4746-98b2-136fe7f6fe4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.695131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1fafc-9803-4746-98b2-136fe7f6fe4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:28.696663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1fafc-9803-4746-98b2-136fe7f6fe4d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-3cc1fafc-9803-4746-98b2-136fe7f6fe4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:28.710289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:28.711318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:28.712434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 494/951] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:28.719176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1fafc-9803-4746-98b2-136fe7f6fe4d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:28.728914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6a27f-dacd-45d5-932c-51042af858aa None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:28.765988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746d03c-b576-4ce1-a7dc-50ddae8bb1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:28.766975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746d03c-b576-4ce1-a7dc-50ddae8bb1fc None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.767255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746d03c-b576-4ce1-a7dc-50ddae8bb1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.767586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746d03c-b576-4ce1-a7dc-50ddae8bb1fc None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/ff1e9d0a33d54a57af28874b4a57738a/roles/a2fad9c023754ad5b921d75bf26d9efc` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.769907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746d03c-b576-4ce1-a7dc-50ddae8bb1fc None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=ff1e9d0a33d54a57af28874b4a57738a, role_id=a2fad9c023754ad5b921d75bf26d9efc)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:28.771891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746d03c-b576-4ce1-a7dc-50ddae8bb1fc None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:28.791435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 458/952] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:09:28 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/ff1e9d0a33d54a57af28874b4a57738a/roles/a2fad9c023754ad5b921d75bf26d9efc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:09:28.807533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:28.847251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1fafc-9803-4746-98b2-136fe7f6fe4d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:28.884253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bbd96-ecdd-42d6-978e-62134b077369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:28.885000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bbd96-ecdd-42d6-978e-62134b077369 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:28.885288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bbd96-ecdd-42d6-978e-62134b077369 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:28.885567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bbd96-ecdd-42d6-978e-62134b077369 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:28.886301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bbd96-ecdd-42d6-978e-62134b077369 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:28.886610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bbd96-ecdd-42d6-978e-62134b077369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:28.888038 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bbd96-ecdd-42d6-978e-62134b077369 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:28.894455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 495/953] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:28.900425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746d03c-b576-4ce1-a7dc-50ddae8bb1fc None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:28.984020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:29.018898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746d03c-b576-4ce1-a7dc-50ddae8bb1fc None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:29.057011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f88ad9-8d17-4e57-853c-ee6068ab1ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:29.058086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f88ad9-8d17-4e57-853c-ee6068ab1ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:29.058625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f88ad9-8d17-4e57-853c-ee6068ab1ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:29.059124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f88ad9-8d17-4e57-853c-ee6068ab1ae8 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:29.060067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f88ad9-8d17-4e57-853c-ee6068ab1ae8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:29.060592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f88ad9-8d17-4e57-853c-ee6068ab1ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:29.062812 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f88ad9-8d17-4e57-853c-ee6068ab1ae8 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:29.068628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 459/954] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:29.074141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bbd96-ecdd-42d6-978e-62134b077369 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:29.178143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bbd96-ecdd-42d6-978e-62134b077369 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:29.203019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:29.214232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08009acc-70d3-4fd1-b861-d5d1408c82a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:29.214892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08009acc-70d3-4fd1-b861-d5d1408c82a0 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:29.215172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08009acc-70d3-4fd1-b861-d5d1408c82a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:29.215474 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08009acc-70d3-4fd1-b861-d5d1408c82a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:29.216340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08009acc-70d3-4fd1-b861-d5d1408c82a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:29.217763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08009acc-70d3-4fd1-b861-d5d1408c82a0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:29.237211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 496/955] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jun 7 14:09:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:30.179693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a1a1-2587-4e9c-9f6e-14ef6b970a43 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:30.180228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a1a1-2587-4e9c-9f6e-14ef6b970a43 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:30.180521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a1a1-2587-4e9c-9f6e-14ef6b970a43 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:30.182408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 460/956] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:30.187849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377931-ab39-4c74-b437-beaad3ecb803 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:30.188638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377931-ab39-4c74-b437-beaad3ecb803 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:30.189130 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377931-ab39-4c74-b437-beaad3ecb803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:30.206838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b5377931-ab39-4c74-b437-beaad3ecb803 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:30.208332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b5377931-ab39-4c74-b437-beaad3ecb803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:30.287436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 497/957] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:30.307825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49a1a1-2587-4e9c-9f6e-14ef6b970a43 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:30.419690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49a1a1-2587-4e9c-9f6e-14ef6b970a43 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:30.463517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:30.464120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:30.464402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:30.464679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:30.465401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:30.466842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:30.468762 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WARNING keystone.server.flask.common [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 07 14:09:30.479012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:30.487918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.sql.core [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 14:09:30.487918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 07 14:09:30.487918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [parameters: {'user_id': '77f2ae4d77834ccfa7fdfafb67492ce9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 07 14:09:30.487918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80292) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application result.read() Jun 07 14:09:30.513381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:09:30.514967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application yield resource Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application next(self.gen) Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self.session.rollback() Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self.force_reraise() Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise self.value Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application session.commit() Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 07 14:09:30.516530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._prepare_impl() Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self.session.flush() Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._flush(objects) Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application compat.raise_( Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application flush_context.execute() Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rec.execute(self) Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 07 14:09:30.517633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 07 14:09:30.518806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application result = self._query(query) Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application conn.query(q) Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application result.read() Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 07 14:09:30.520771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [parameters: {'user_id': '77f2ae4d77834ccfa7fdfafb67492ce9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:30.523597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 07 14:09:30.528549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 07 14:09:30.531310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 07 14:09:30.531310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 07 14:09:30.531310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 07 14:09:30.531310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 07 14:09:30.531310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 07 14:09:30.531310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:30.531310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 461/958] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jun 7 14:09:30 2022] POST /identity/v3/users => generated 160 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:30.536143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5377931-ab39-4c74-b437-beaad3ecb803 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:30.638210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5377931-ab39-4c74-b437-beaad3ecb803 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:30.646798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:30.675926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593651ff-e320-4109-b965-c0889c082505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:30.677125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593651ff-e320-4109-b965-c0889c082505 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:30.677603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593651ff-e320-4109-b965-c0889c082505 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:30.678070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593651ff-e320-4109-b965-c0889c082505 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:30.685623 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593651ff-e320-4109-b965-c0889c082505 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:30.687834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593651ff-e320-4109-b965-c0889c082505 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-593651ff-e320-4109-b965-c0889c082505 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:30.703483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:30.704434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 07 14:09:30.705394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:30.711429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 498/959] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:30.714250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:30.768383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9275e2-0257-43d1-892e-9d9b57b8db3d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:30.769001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9275e2-0257-43d1-892e-9d9b57b8db3d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:30.769511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9275e2-0257-43d1-892e-9d9b57b8db3d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:30.771417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 499/960] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:30.777231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f8eb-d5b3-4e71-a7e3-a036c2119c5a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:30.777511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f8eb-d5b3-4e71-a7e3-a036c2119c5a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:30.777783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2f8eb-d5b3-4e71-a7e3-a036c2119c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:30.798514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5de2f8eb-d5b3-4e71-a7e3-a036c2119c5a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:30.799732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5de2f8eb-d5b3-4e71-a7e3-a036c2119c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:30.827577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688f9b6-c9de-4062-9a06-7267befc8337 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:30.868489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a856-b8bd-4edf-a2ef-39bdaffb9228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:30.869521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a856-b8bd-4edf-a2ef-39bdaffb9228 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:30.870048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a856-b8bd-4edf-a2ef-39bdaffb9228 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:30.870522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a856-b8bd-4edf-a2ef-39bdaffb9228 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:30.871560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a856-b8bd-4edf-a2ef-39bdaffb9228 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:30.872089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a856-b8bd-4edf-a2ef-39bdaffb9228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:30.874564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a856-b8bd-4edf-a2ef-39bdaffb9228 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:30.891377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 500/961] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:30.907933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2f8eb-d5b3-4e71-a7e3-a036c2119c5a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:30.923460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 462/962] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jun 7 14:09:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:31.017688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:31.024863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2f8eb-d5b3-4e71-a7e3-a036c2119c5a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:31.063021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c36414-1268-49b8-afe2-be587ec03138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:31.064283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c36414-1268-49b8-afe2-be587ec03138 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.064768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c36414-1268-49b8-afe2-be587ec03138 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.065242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c36414-1268-49b8-afe2-be587ec03138 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.066127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c36414-1268-49b8-afe2-be587ec03138 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:31.067763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c36414-1268-49b8-afe2-be587ec03138 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-88c36414-1268-49b8-afe2-be587ec03138 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:31.081025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:31.082142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:09:31.082981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:31.086019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 501/963] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:31.092482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a856-b8bd-4edf-a2ef-39bdaffb9228 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:31.156548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:31.174908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20720901-d480-45b8-beb2-ced474901cdb None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.175103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20720901-d480-45b8-beb2-ced474901cdb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.175415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20720901-d480-45b8-beb2-ced474901cdb None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.176914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 502/964] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:31.182464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44bde6-02a3-4453-8501-cd0b8552decf None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.183017 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44bde6-02a3-4453-8501-cd0b8552decf None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.183655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44bde6-02a3-4453-8501-cd0b8552decf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.202346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5c44bde6-02a3-4453-8501-cd0b8552decf None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:31.204548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5c44bde6-02a3-4453-8501-cd0b8552decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:31.207484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a856-b8bd-4edf-a2ef-39bdaffb9228 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:31.247129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2998-ac43-4a66-ab6c-a7b8000d9f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:31.247926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2998-ac43-4a66-ab6c-a7b8000d9f6c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.248318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2998-ac43-4a66-ab6c-a7b8000d9f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.249193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2998-ac43-4a66-ab6c-a7b8000d9f6c None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.250015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c2998-ac43-4a66-ab6c-a7b8000d9f6c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:31.250287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c2998-ac43-4a66-ab6c-a7b8000d9f6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:31.251875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c2998-ac43-4a66-ab6c-a7b8000d9f6c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:31.258151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 463/965] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:31.263884 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2998-ac43-4a66-ab6c-a7b8000d9f6c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:31.288506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 503/966] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:31.312405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44bde6-02a3-4453-8501-cd0b8552decf None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:31.375696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2998-ac43-4a66-ab6c-a7b8000d9f6c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:31.396103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:31.409555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:31.411518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76674d-9195-4a2c-b5fb-54549090dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:31.412274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76674d-9195-4a2c-b5fb-54549090dd8f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.412633 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76674d-9195-4a2c-b5fb-54549090dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.412947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76674d-9195-4a2c-b5fb-54549090dd8f None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.413675 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76674d-9195-4a2c-b5fb-54549090dd8f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:31.413977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76674d-9195-4a2c-b5fb-54549090dd8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:31.415374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76674d-9195-4a2c-b5fb-54549090dd8f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:31.419965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 464/967] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:31.422364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44bde6-02a3-4453-8501-cd0b8552decf None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:31.469525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4629def-1015-426c-83e6-3a7f60951b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:31.470352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629def-1015-426c-83e6-3a7f60951b34 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.470631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629def-1015-426c-83e6-3a7f60951b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.470905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4629def-1015-426c-83e6-3a7f60951b34 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.484523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4629def-1015-426c-83e6-3a7f60951b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a4629def-1015-426c-83e6-3a7f60951b34 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:31.493525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:31.494561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:31.495461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:31.496643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 504/968] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jun 7 14:09:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:31.503201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76674d-9195-4a2c-b5fb-54549090dd8f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:31.577248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182af80-0cb9-459a-b029-273aa2620b89 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.577455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182af80-0cb9-459a-b029-273aa2620b89 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.577729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182af80-0cb9-459a-b029-273aa2620b89 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.579127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 505/969] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:31.584824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f91c3-7175-459e-961e-86f0ebc9fcc9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.585142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f91c3-7175-459e-961e-86f0ebc9fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.585391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f91c3-7175-459e-961e-86f0ebc9fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.604176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ef3f91c3-7175-459e-961e-86f0ebc9fcc9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:31.605492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ef3f91c3-7175-459e-961e-86f0ebc9fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:31.619520 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76674d-9195-4a2c-b5fb-54549090dd8f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:31.654034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a951-d1e2-4a7f-809c-10dd7f84b110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:31.654706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a951-d1e2-4a7f-809c-10dd7f84b110 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.655846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a951-d1e2-4a7f-809c-10dd7f84b110 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.655970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a951-d1e2-4a7f-809c-10dd7f84b110 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.656645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5a951-d1e2-4a7f-809c-10dd7f84b110 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:31.656951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5a951-d1e2-4a7f-809c-10dd7f84b110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:31.658387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5a951-d1e2-4a7f-809c-10dd7f84b110 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:31.671039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 465/970] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jun 7 14:09:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:31.672890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a951-d1e2-4a7f-809c-10dd7f84b110 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:31.691470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 506/971] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:31.711070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f91c3-7175-459e-961e-86f0ebc9fcc9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:31.729850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:31.791819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a951-d1e2-4a7f-809c-10dd7f84b110 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:31.794879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:31.814604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f91c3-7175-459e-961e-86f0ebc9fcc9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:31.834988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496ccf8-749d-4b07-aa10-dc38d2260254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:31.835735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496ccf8-749d-4b07-aa10-dc38d2260254 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.836437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496ccf8-749d-4b07-aa10-dc38d2260254 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.836720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496ccf8-749d-4b07-aa10-dc38d2260254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.848089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496ccf8-749d-4b07-aa10-dc38d2260254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:31.849536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496ccf8-749d-4b07-aa10-dc38d2260254 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:31.850374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b1522-8f54-44be-881e-88dc9b221bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:31.851170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1522-8f54-44be-881e-88dc9b221bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:31.851478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1522-8f54-44be-881e-88dc9b221bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:31.851755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b1522-8f54-44be-881e-88dc9b221bb7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:31.852399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b1522-8f54-44be-881e-88dc9b221bb7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:31.853730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b1522-8f54-44be-881e-88dc9b221bb7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-625b1522-8f54-44be-881e-88dc9b221bb7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:31.865609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:31.866600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:31.872854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-b496ccf8-749d-4b07-aa10-dc38d2260254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:31.873694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:31.874524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:31.875468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:31.875468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:31.875468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:31.875468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:31.875706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 507/972] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:31.875776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 466/973] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:31.875853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b1522-8f54-44be-881e-88dc9b221bb7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:31.875933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496ccf8-749d-4b07-aa10-dc38d2260254 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:31.982223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b1522-8f54-44be-881e-88dc9b221bb7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:31.982919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:31.987152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496ccf8-749d-4b07-aa10-dc38d2260254 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:32.020224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc10b9-c559-4258-8e76-dc5f51bb4a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:32.020959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc10b9-c559-4258-8e76-dc5f51bb4a64 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:32.021247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc10b9-c559-4258-8e76-dc5f51bb4a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:32.021528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc10b9-c559-4258-8e76-dc5f51bb4a64 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:32.022289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc10b9-c559-4258-8e76-dc5f51bb4a64 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:32.022604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc10b9-c559-4258-8e76-dc5f51bb4a64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:32.022939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f1751-04a9-4601-8690-0abb63be29f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:32.023635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f1751-04a9-4601-8690-0abb63be29f6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:32.023920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f1751-04a9-4601-8690-0abb63be29f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:32.024015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc10b9-c559-4258-8e76-dc5f51bb4a64 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:32.024199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f1751-04a9-4601-8690-0abb63be29f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:32.024935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f1751-04a9-4601-8690-0abb63be29f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:32.025237 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f1751-04a9-4601-8690-0abb63be29f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:32.026591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f1751-04a9-4601-8690-0abb63be29f6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:32.029269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 508/974] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:32.035807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc10b9-c559-4258-8e76-dc5f51bb4a64 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:32.039802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 467/975] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:32.045045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f1751-04a9-4601-8690-0abb63be29f6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:32.053244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:32.148692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc10b9-c559-4258-8e76-dc5f51bb4a64 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:32.157447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f1751-04a9-4601-8690-0abb63be29f6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:32.183507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a431-f582-4952-98a9-72feec8ea496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:32.184180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a431-f582-4952-98a9-72feec8ea496 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:32.184464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a431-f582-4952-98a9-72feec8ea496 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:32.184742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a431-f582-4952-98a9-72feec8ea496 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:32.185454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8a431-f582-4952-98a9-72feec8ea496 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:32.185763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8a431-f582-4952-98a9-72feec8ea496 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:32.187700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8a431-f582-4952-98a9-72feec8ea496 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:32.192916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 509/976] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:32.194776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5323fef-3983-44e6-84a9-d883fadeafe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:32.196037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5323fef-3983-44e6-84a9-d883fadeafe1 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:32.196467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5323fef-3983-44e6-84a9-d883fadeafe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:32.196919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5323fef-3983-44e6-84a9-d883fadeafe1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:32.199071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a431-f582-4952-98a9-72feec8ea496 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:32.205696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5323fef-3983-44e6-84a9-d883fadeafe1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:32.207134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5323fef-3983-44e6-84a9-d883fadeafe1 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-f5323fef-3983-44e6-84a9-d883fadeafe1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:32.222098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:32.223857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:32.224883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 468/977] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:09:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:32.228819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5323fef-3983-44e6-84a9-d883fadeafe1 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:32.248279 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:32.278094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:32.313299 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a431-f582-4952-98a9-72feec8ea496 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:32.337698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5323fef-3983-44e6-84a9-d883fadeafe1 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:32.353967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cde145-79c3-49c6-81fc-e9b41444b118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:32.354621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cde145-79c3-49c6-81fc-e9b41444b118 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:32.354910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cde145-79c3-49c6-81fc-e9b41444b118 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:32.355180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cde145-79c3-49c6-81fc-e9b41444b118 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:32.356018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cde145-79c3-49c6-81fc-e9b41444b118 None admin] RBAC: Adding query filter params (interface=admin, service_id=f22d551bbc514b7cb35a408abd4946e7, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:32.356331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cde145-79c3-49c6-81fc-e9b41444b118 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:32.357681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cde145-79c3-49c6-81fc-e9b41444b118 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:32.367164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 510/978] 10.222.0.77 () {56 vars in 1249 bytes} [Tue Jun 7 14:09:32 2022] GET /identity/v3/endpoints?service_id=f22d551bbc514b7cb35a408abd4946e7&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:32.368478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cde145-79c3-49c6-81fc-e9b41444b118 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:32.372854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adf527-099f-45c1-bd75-27bb1367711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:32.374038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adf527-099f-45c1-bd75-27bb1367711d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:32.374340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adf527-099f-45c1-bd75-27bb1367711d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:32.374619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adf527-099f-45c1-bd75-27bb1367711d None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:32.375499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adf527-099f-45c1-bd75-27bb1367711d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:32.375814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adf527-099f-45c1-bd75-27bb1367711d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:32.377232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adf527-099f-45c1-bd75-27bb1367711d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:32.394952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 469/979] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jun 7 14:09:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:32.400367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adf527-099f-45c1-bd75-27bb1367711d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:32.477216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:32.479430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cde145-79c3-49c6-81fc-e9b41444b118 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:32.509555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adf527-099f-45c1-bd75-27bb1367711d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:32.519887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34568abe-5145-4fac-a989-4c7091868f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:32.520563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34568abe-5145-4fac-a989-4c7091868f01 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:32.520845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34568abe-5145-4fac-a989-4c7091868f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:32.521186 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34568abe-5145-4fac-a989-4c7091868f01 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:32.521866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34568abe-5145-4fac-a989-4c7091868f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:32.523205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34568abe-5145-4fac-a989-4c7091868f01 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:32.525268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:32.531669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 511/980] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jun 7 14:09:32 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:09:32.551616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007043e9-6801-47a4-8015-358ede4bca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:32.552590 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007043e9-6801-47a4-8015-358ede4bca8d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:32.553061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007043e9-6801-47a4-8015-358ede4bca8d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:32.553506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007043e9-6801-47a4-8015-358ede4bca8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:32.631645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007043e9-6801-47a4-8015-358ede4bca8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:32.633146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007043e9-6801-47a4-8015-358ede4bca8d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:32.724770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:32.753909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 470/981] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:32 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:09:32.759728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34568abe-5145-4fac-a989-4c7091868f01 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:32.863041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34568abe-5145-4fac-a989-4c7091868f01 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:32.896042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d92b1-2972-44ee-a1da-b2fd332e1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:32.896838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d92b1-2972-44ee-a1da-b2fd332e1442 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:32.897124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d92b1-2972-44ee-a1da-b2fd332e1442 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:32.897400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d92b1-2972-44ee-a1da-b2fd332e1442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:32.908617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d92b1-2972-44ee-a1da-b2fd332e1442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:32.910059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d92b1-2972-44ee-a1da-b2fd332e1442 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-258d92b1-2972-44ee-a1da-b2fd332e1442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:32.927761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:32.928656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:32.929559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:32.929559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:32.929559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:32.929559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:32.930408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 512/982] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:32.934926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007043e9-6801-47a4-8015-358ede4bca8d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:33.037477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007043e9-6801-47a4-8015-358ede4bca8d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:33.072488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df7ebb-637b-4043-87d3-55e0934defbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:33.073161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df7ebb-637b-4043-87d3-55e0934defbf None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:33.073446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df7ebb-637b-4043-87d3-55e0934defbf None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:33.073722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df7ebb-637b-4043-87d3-55e0934defbf None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:33.074449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df7ebb-637b-4043-87d3-55e0934defbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:33.074757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df7ebb-637b-4043-87d3-55e0934defbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:33.076149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df7ebb-637b-4043-87d3-55e0934defbf None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:33.091382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 471/983] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:33.094067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d92b1-2972-44ee-a1da-b2fd332e1442 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:33.149819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:33.199103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d92b1-2972-44ee-a1da-b2fd332e1442 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:33.234083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3f5d1-6d3d-4bd6-b3b6-4aec85d212d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:33.234891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f5d1-6d3d-4bd6-b3b6-4aec85d212d9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:33.235179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f5d1-6d3d-4bd6-b3b6-4aec85d212d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:33.235506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f5d1-6d3d-4bd6-b3b6-4aec85d212d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:33.242394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3f5d1-6d3d-4bd6-b3b6-4aec85d212d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:33.243864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3f5d1-6d3d-4bd6-b3b6-4aec85d212d9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-c2f3f5d1-6d3d-4bd6-b3b6-4aec85d212d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:33.259449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:33.260409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:33.261323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:33.261323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:33.261323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:33.261323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:33.261323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:33.261323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:33.261323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:33.261323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:33.263484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 513/984] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:33.266961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df7ebb-637b-4043-87d3-55e0934defbf None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:33.304998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:33.374819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df7ebb-637b-4043-87d3-55e0934defbf None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:33.411584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efa18d5-d563-4627-989b-12decf8d1b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:33.412255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa18d5-d563-4627-989b-12decf8d1b06 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:33.412541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa18d5-d563-4627-989b-12decf8d1b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:33.412821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa18d5-d563-4627-989b-12decf8d1b06 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:33.413613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa18d5-d563-4627-989b-12decf8d1b06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:33.413925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa18d5-d563-4627-989b-12decf8d1b06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:33.415373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efa18d5-d563-4627-989b-12decf8d1b06 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:33.432089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 472/985] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:33.433270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3f5d1-6d3d-4bd6-b3b6-4aec85d212d9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:33.539649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3f5d1-6d3d-4bd6-b3b6-4aec85d212d9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:33.552694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:33.575298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204964-3639-4553-9b46-4cdddf0f2e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:33.575913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204964-3639-4553-9b46-4cdddf0f2e48 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:33.576199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204964-3639-4553-9b46-4cdddf0f2e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:33.576480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204964-3639-4553-9b46-4cdddf0f2e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:33.577879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53204964-3639-4553-9b46-4cdddf0f2e48 None admin] RBAC: Adding query filter params (role.id=a2fad9c023754ad5b921d75bf26d9efc, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=ff1e9d0a33d54a57af28874b4a57738a) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:33.578197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53204964-3639-4553-9b46-4cdddf0f2e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:33.579641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53204964-3639-4553-9b46-4cdddf0f2e48 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:33.591367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 514/986] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:33 2022] GET /identity/v3/role_assignments?user.id=ff1e9d0a33d54a57af28874b4a57738a&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=a2fad9c023754ad5b921d75bf26d9efc => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:33.709336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e3dc-9232-4f55-8726-f7e076f88cf1 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:33.709625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e3dc-9232-4f55-8726-f7e076f88cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:33.709906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e3dc-9232-4f55-8726-f7e076f88cf1 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:33.711296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 473/987] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:33.716854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6670b9-f708-480f-8aae-168de775a6d5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:33.717145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6670b9-f708-480f-8aae-168de775a6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:33.717459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6670b9-f708-480f-8aae-168de775a6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:33.735045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4c6670b9-f708-480f-8aae-168de775a6d5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:33.736293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4c6670b9-f708-480f-8aae-168de775a6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:33.808917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 515/988] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:33.832413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e3dc-9232-4f55-8726-f7e076f88cf1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:33.929527 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:33.937433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e3dc-9232-4f55-8726-f7e076f88cf1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:33.972790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52e096-a2fc-4c1c-bcac-e92e7ef8a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:33.973470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e096-a2fc-4c1c-bcac-e92e7ef8a2b8 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:33.973755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e096-a2fc-4c1c-bcac-e92e7ef8a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:33.974033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e096-a2fc-4c1c-bcac-e92e7ef8a2b8 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:33.974771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e096-a2fc-4c1c-bcac-e92e7ef8a2b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:33.976161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e096-a2fc-4c1c-bcac-e92e7ef8a2b8 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:33.990439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 474/989] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:09:33 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:34.774408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7be5-e6fd-4146-8bb4-14ee49dd54d5 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:34.774899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7be5-e6fd-4146-8bb4-14ee49dd54d5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:34.774899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7be5-e6fd-4146-8bb4-14ee49dd54d5 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:34.776405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 516/990] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:34.781826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ecd48-a652-46d1-abe6-9a014de9a864 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:34.782249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ecd48-a652-46d1-abe6-9a014de9a864 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:34.782431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ecd48-a652-46d1-abe6-9a014de9a864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:34.800052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-648ecd48-a652-46d1-abe6-9a014de9a864 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:34.801587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-648ecd48-a652-46d1-abe6-9a014de9a864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:34.878095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 475/991] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:34.900959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f7be5-e6fd-4146-8bb4-14ee49dd54d5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:35.002421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f7be5-e6fd-4146-8bb4-14ee49dd54d5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:35.009603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:35.037154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43463a1b-012b-42a7-b648-ccc7ef86b242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:35.037887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43463a1b-012b-42a7-b648-ccc7ef86b242 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:35.038171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43463a1b-012b-42a7-b648-ccc7ef86b242 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:35.038450 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43463a1b-012b-42a7-b648-ccc7ef86b242 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:35.039111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43463a1b-012b-42a7-b648-ccc7ef86b242 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:35.040498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43463a1b-012b-42a7-b648-ccc7ef86b242 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-43463a1b-012b-42a7-b648-ccc7ef86b242 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:35.052923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:35.053896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 07 14:09:35.054748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:35.056357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 517/992] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jun 7 14:09:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:35.060127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ecd48-a652-46d1-abe6-9a014de9a864 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:35.150199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:35.173909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ecd48-a652-46d1-abe6-9a014de9a864 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:35.210567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefad5f-8dc0-46cc-9b76-31e4ee04fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:35.211408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefad5f-8dc0-46cc-9b76-31e4ee04fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:35.211696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefad5f-8dc0-46cc-9b76-31e4ee04fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:35.211972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefad5f-8dc0-46cc-9b76-31e4ee04fcd2 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:35.212697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefad5f-8dc0-46cc-9b76-31e4ee04fcd2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:35.213002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefad5f-8dc0-46cc-9b76-31e4ee04fcd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:35.214374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefad5f-8dc0-46cc-9b76-31e4ee04fcd2 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:35.222282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 476/993] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:35.225908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43463a1b-012b-42a7-b648-ccc7ef86b242 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:35.331485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43463a1b-012b-42a7-b648-ccc7ef86b242 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:35.365401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321d096-7296-41cb-9954-1865308f7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:35.366061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d096-7296-41cb-9954-1865308f7e4b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:35.366342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d096-7296-41cb-9954-1865308f7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:35.366616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321d096-7296-41cb-9954-1865308f7e4b None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:35.367325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d096-7296-41cb-9954-1865308f7e4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:35.367659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d096-7296-41cb-9954-1865308f7e4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:35.369020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321d096-7296-41cb-9954-1865308f7e4b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:35.378692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 518/994] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jun 7 14:09:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:35.379918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefad5f-8dc0-46cc-9b76-31e4ee04fcd2 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:35.486712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefad5f-8dc0-46cc-9b76-31e4ee04fcd2 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:35.522128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6657ed8-b0a3-4917-8dd3-453d512a187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:35.522796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6657ed8-b0a3-4917-8dd3-453d512a187d None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:35.523080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6657ed8-b0a3-4917-8dd3-453d512a187d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:35.523381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6657ed8-b0a3-4917-8dd3-453d512a187d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:35.524157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6657ed8-b0a3-4917-8dd3-453d512a187d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:35.525596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6657ed8-b0a3-4917-8dd3-453d512a187d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:35.543909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 477/995] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jun 7 14:09:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:09:35.871372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b21d5-af04-4e28-aba4-79ca22598706 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:35.871892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b21d5-af04-4e28-aba4-79ca22598706 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:35.871971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b21d5-af04-4e28-aba4-79ca22598706 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:35.873412 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 519/996] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:35.879075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f8566-5361-432c-95ac-b46a97d5c5f9 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:35.879497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f8566-5361-432c-95ac-b46a97d5c5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:35.879693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f8566-5361-432c-95ac-b46a97d5c5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:35.891117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:35.898022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-417f8566-5361-432c-95ac-b46a97d5c5f9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:35.899778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-417f8566-5361-432c-95ac-b46a97d5c5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:35.976448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 478/997] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:35.998139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b21d5-af04-4e28-aba4-79ca22598706 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:36.034033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:36.103923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b21d5-af04-4e28-aba4-79ca22598706 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:36.136912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53832e7c-6c5c-4100-a9b4-1fd9d54b488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:36.137698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53832e7c-6c5c-4100-a9b4-1fd9d54b488b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:36.138031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53832e7c-6c5c-4100-a9b4-1fd9d54b488b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:36.138307 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53832e7c-6c5c-4100-a9b4-1fd9d54b488b None admin] PATH_INFO: `/v3/services/image` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:36.138950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53832e7c-6c5c-4100-a9b4-1fd9d54b488b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:36.140879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53832e7c-6c5c-4100-a9b4-1fd9d54b488b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-53832e7c-6c5c-4100-a9b4-1fd9d54b488b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:36.152376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:36.153407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:09:36.154255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:36.158560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 520/998] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Jun 7 14:09:35 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:36.159933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f8566-5361-432c-95ac-b46a97d5c5f9 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:36.260487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f8566-5361-432c-95ac-b46a97d5c5f9 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:36.275063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7592e26-957f-4447-b3fe-bebbdc37e577 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:36.275511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7592e26-957f-4447-b3fe-bebbdc37e577 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:36.275866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7592e26-957f-4447-b3fe-bebbdc37e577 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:36.277456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 521/999] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:36.282672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ba365-17c9-401d-836e-8ffb262925bf None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:36.283177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ba365-17c9-401d-836e-8ffb262925bf None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:36.283500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ba365-17c9-401d-836e-8ffb262925bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:36.292223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:36.297950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b304044-360a-44fb-9e66-db5a5b8f0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:36.298817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304044-360a-44fb-9e66-db5a5b8f0f7c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:36.299708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304044-360a-44fb-9e66-db5a5b8f0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:36.300003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b304044-360a-44fb-9e66-db5a5b8f0f7c None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:36.300737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b304044-360a-44fb-9e66-db5a5b8f0f7c None admin] RBAC: Adding query filter params (name=image) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:36.301053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b304044-360a-44fb-9e66-db5a5b8f0f7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:36.302423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b304044-360a-44fb-9e66-db5a5b8f0f7c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:36.302526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-994ba365-17c9-401d-836e-8ffb262925bf None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:36.303721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-994ba365-17c9-401d-836e-8ffb262925bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:36.307656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 479/1000] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:36.313511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b304044-360a-44fb-9e66-db5a5b8f0f7c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:36.373790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 522/1001] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:36.396635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ba365-17c9-401d-836e-8ffb262925bf None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:36.425894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:36.430281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b304044-360a-44fb-9e66-db5a5b8f0f7c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:36.465494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55979-ffb0-4f6b-b3a9-351a8b436c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:36.466152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55979-ffb0-4f6b-b3a9-351a8b436c42 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:36.466431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55979-ffb0-4f6b-b3a9-351a8b436c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:36.466700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55979-ffb0-4f6b-b3a9-351a8b436c42 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:36.467434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55979-ffb0-4f6b-b3a9-351a8b436c42 None admin] RBAC: Adding query filter params (type=image) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:36.467766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55979-ffb0-4f6b-b3a9-351a8b436c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:36.469115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55979-ffb0-4f6b-b3a9-351a8b436c42 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:36.474189 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 480/1002] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:36.511007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ba365-17c9-401d-836e-8ffb262925bf None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:36.550000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15759-945a-45e6-9bc3-3bb98c08caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:36.550938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15759-945a-45e6-9bc3-3bb98c08caca None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:36.551226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15759-945a-45e6-9bc3-3bb98c08caca None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:36.551547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f15759-945a-45e6-9bc3-3bb98c08caca None admin] PATH_INFO: `/v3/services/compute` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:36.552194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15759-945a-45e6-9bc3-3bb98c08caca None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:36.553571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f15759-945a-45e6-9bc3-3bb98c08caca None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-71f15759-945a-45e6-9bc3-3bb98c08caca None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:36.566432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:36.567582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:36.568459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 523/1003] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:36.576656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55979-ffb0-4f6b-b3a9-351a8b436c42 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:36.642203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:36.691220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55979-ffb0-4f6b-b3a9-351a8b436c42 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:36.728191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3ae83-7e40-4622-ab9e-b208442b9a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:36.729102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3ae83-7e40-4622-ab9e-b208442b9a8f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:36.729565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3ae83-7e40-4622-ab9e-b208442b9a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:36.729985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3ae83-7e40-4622-ab9e-b208442b9a8f None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:36.730852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3ae83-7e40-4622-ab9e-b208442b9a8f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:36.731302 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3ae83-7e40-4622-ab9e-b208442b9a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:36.732825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3ae83-7e40-4622-ab9e-b208442b9a8f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:36.738784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 481/1004] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:36.744626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15759-945a-45e6-9bc3-3bb98c08caca None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:36.837405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:36.848471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f15759-945a-45e6-9bc3-3bb98c08caca None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:36.881561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8005d8d-cd29-4a2a-9a08-20de1aec47e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:36.882328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8005d8d-cd29-4a2a-9a08-20de1aec47e6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:36.882500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8005d8d-cd29-4a2a-9a08-20de1aec47e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:36.882760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8005d8d-cd29-4a2a-9a08-20de1aec47e6 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:36.883495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8005d8d-cd29-4a2a-9a08-20de1aec47e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:36.883801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8005d8d-cd29-4a2a-9a08-20de1aec47e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:36.885138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8005d8d-cd29-4a2a-9a08-20de1aec47e6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:36.890594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 524/1005] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:36.896124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3ae83-7e40-4622-ab9e-b208442b9a8f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:36.996760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3ae83-7e40-4622-ab9e-b208442b9a8f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:37.020911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:37.033398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d38fe-925d-4efd-84d1-64c4b8e8353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:37.034128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d38fe-925d-4efd-84d1-64c4b8e8353f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:37.034476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d38fe-925d-4efd-84d1-64c4b8e8353f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:37.034816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d38fe-925d-4efd-84d1-64c4b8e8353f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:37.035713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d38fe-925d-4efd-84d1-64c4b8e8353f None admin] RBAC: Adding query filter params (interface=public, service_id=0cba6353fd924ce98d5881b45be6f0ce, region_id=RegionOne) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:37.036087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d38fe-925d-4efd-84d1-64c4b8e8353f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:37.037518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d38fe-925d-4efd-84d1-64c4b8e8353f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:37.042780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 482/1006] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jun 7 14:09:36 2022] GET /identity/v3/endpoints?service_id=0cba6353fd924ce98d5881b45be6f0ce&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:37.048061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8005d8d-cd29-4a2a-9a08-20de1aec47e6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:37.146502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8005d8d-cd29-4a2a-9a08-20de1aec47e6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:37.180108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01a101-7e29-4af6-94ef-efd275b8aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:37.180766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01a101-7e29-4af6-94ef-efd275b8aa59 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:37.181045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01a101-7e29-4af6-94ef-efd275b8aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:37.181316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01a101-7e29-4af6-94ef-efd275b8aa59 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:37.181991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01a101-7e29-4af6-94ef-efd275b8aa59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:37.183352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01a101-7e29-4af6-94ef-efd275b8aa59 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:37.195394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 525/1007] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jun 7 14:09:37 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:09:37.801793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774d12-db06-4810-b64a-954250f95b47 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:37.801986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774d12-db06-4810-b64a-954250f95b47 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:37.802270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774d12-db06-4810-b64a-954250f95b47 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:37.803850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 483/1008] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:37.808859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86649c02-133c-4095-9014-92e7ad83884c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:37.809156 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86649c02-133c-4095-9014-92e7ad83884c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:37.809441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86649c02-133c-4095-9014-92e7ad83884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:37.826854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-86649c02-133c-4095-9014-92e7ad83884c None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:37.828084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-86649c02-133c-4095-9014-92e7ad83884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:37.842764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:37.897952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 526/1009] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:37.921672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774d12-db06-4810-b64a-954250f95b47 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:38.025161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774d12-db06-4810-b64a-954250f95b47 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:38.059684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4aa05-e6b9-49b7-b655-b38595aba724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:38.060407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4aa05-e6b9-49b7-b655-b38595aba724 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:38.060690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4aa05-e6b9-49b7-b655-b38595aba724 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:38.060963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4aa05-e6b9-49b7-b655-b38595aba724 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:38.062171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4aa05-e6b9-49b7-b655-b38595aba724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:38.063623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4aa05-e6b9-49b7-b655-b38595aba724 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:38.070193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 484/1010] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:38.071477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86649c02-133c-4095-9014-92e7ad83884c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:38.169258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86649c02-133c-4095-9014-92e7ad83884c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:38.203095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b246b-f35b-4c8f-9b9e-4309905a8310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:38.203780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b246b-f35b-4c8f-9b9e-4309905a8310 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:38.204079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b246b-f35b-4c8f-9b9e-4309905a8310 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:38.204342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b246b-f35b-4c8f-9b9e-4309905a8310 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:38.205061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b246b-f35b-4c8f-9b9e-4309905a8310 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:38.206476 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b246b-f35b-4c8f-9b9e-4309905a8310 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:38.235985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 527/1011] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:09:38 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:38.725695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d96c7-c5c5-4b29-9c56-9249c23ba935 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:38.726063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d96c7-c5c5-4b29-9c56-9249c23ba935 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:38.726255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d96c7-c5c5-4b29-9c56-9249c23ba935 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:38.727840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 485/1012] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:38.732920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be61ff-7204-46be-b945-4b0f2cd534c7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:38.733215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be61ff-7204-46be-b945-4b0f2cd534c7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:38.733566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be61ff-7204-46be-b945-4b0f2cd534c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:38.739171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:38.753318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-86be61ff-7204-46be-b945-4b0f2cd534c7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:38.754430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-86be61ff-7204-46be-b945-4b0f2cd534c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:38.828421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 528/1013] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:38.854373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d96c7-c5c5-4b29-9c56-9249c23ba935 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:38.914381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:38.961172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d96c7-c5c5-4b29-9c56-9249c23ba935 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:38.994865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649ddfa-63ca-45ac-8114-7366cf442168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:38.995564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649ddfa-63ca-45ac-8114-7366cf442168 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:38.995853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649ddfa-63ca-45ac-8114-7366cf442168 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:38.996131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649ddfa-63ca-45ac-8114-7366cf442168 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:38.996856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649ddfa-63ca-45ac-8114-7366cf442168 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:38.998209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649ddfa-63ca-45ac-8114-7366cf442168 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:39.012410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 486/1014] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:09:38 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:09:39.463817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1acf-3e30-47c4-abd0-48d87ba3abd4 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:39.464361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1acf-3e30-47c4-abd0-48d87ba3abd4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:39.464361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1acf-3e30-47c4-abd0-48d87ba3abd4 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:39.465917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 529/1015] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:39.470987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc6f32-ce9d-4fdd-b8e2-87f5c538ccba None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:39.471288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc6f32-ce9d-4fdd-b8e2-87f5c538ccba None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:39.471604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc6f32-ce9d-4fdd-b8e2-87f5c538ccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:39.489262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-2efc6f32-ce9d-4fdd-b8e2-87f5c538ccba None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:39.491546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2efc6f32-ce9d-4fdd-b8e2-87f5c538ccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:39.567460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 487/1016] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:39 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:39.590178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1acf-3e30-47c4-abd0-48d87ba3abd4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:39.693885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1acf-3e30-47c4-abd0-48d87ba3abd4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:39.724320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:39.729792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fa1e7-ffab-4f39-86eb-bd45b78cf916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:39.730955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fa1e7-ffab-4f39-86eb-bd45b78cf916 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:39.731588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fa1e7-ffab-4f39-86eb-bd45b78cf916 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:39.732221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fa1e7-ffab-4f39-86eb-bd45b78cf916 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:39.732880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fa1e7-ffab-4f39-86eb-bd45b78cf916 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:39.734901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fa1e7-ffab-4f39-86eb-bd45b78cf916 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-144fa1e7-ffab-4f39-86eb-bd45b78cf916 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:39.746947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:39.747994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:39.755582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 530/1017] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:39.756404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc6f32-ce9d-4fdd-b8e2-87f5c538ccba None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:39.799926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:39.859960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc6f32-ce9d-4fdd-b8e2-87f5c538ccba None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:39.894662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf39b-bf68-4306-a749-04f0ec6d18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:39.895353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf39b-bf68-4306-a749-04f0ec6d18f7 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:39.895653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf39b-bf68-4306-a749-04f0ec6d18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:39.895932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf39b-bf68-4306-a749-04f0ec6d18f7 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:39.896641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cf39b-bf68-4306-a749-04f0ec6d18f7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:39.896949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cf39b-bf68-4306-a749-04f0ec6d18f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:39.898303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cf39b-bf68-4306-a749-04f0ec6d18f7 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:39.905044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 488/1018] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:39.909039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fa1e7-ffab-4f39-86eb-bd45b78cf916 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:40.013894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fa1e7-ffab-4f39-86eb-bd45b78cf916 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:40.048904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b83d0-4d3b-4172-bd4e-32a8427d94b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:40.049573 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b83d0-4d3b-4172-bd4e-32a8427d94b7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:40.049860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b83d0-4d3b-4172-bd4e-32a8427d94b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:40.050140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b83d0-4d3b-4172-bd4e-32a8427d94b7 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:40.050849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b83d0-4d3b-4172-bd4e-32a8427d94b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:40.051159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b83d0-4d3b-4172-bd4e-32a8427d94b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:40.052544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b83d0-4d3b-4172-bd4e-32a8427d94b7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:40.063164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 531/1019] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jun 7 14:09:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:40.064135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf39b-bf68-4306-a749-04f0ec6d18f7 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:40.166750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf39b-bf68-4306-a749-04f0ec6d18f7 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:40.174930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:40.205774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778059a-e4a7-4f30-a2c4-bee9e99436dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:40.206462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778059a-e4a7-4f30-a2c4-bee9e99436dd None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:40.206749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778059a-e4a7-4f30-a2c4-bee9e99436dd None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:40.207029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778059a-e4a7-4f30-a2c4-bee9e99436dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:40.207904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778059a-e4a7-4f30-a2c4-bee9e99436dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:40.209327 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778059a-e4a7-4f30-a2c4-bee9e99436dd None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:40.235378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 489/1020] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jun 7 14:09:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:09:40.534802 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38da7f7-2090-4a0e-924d-6a17e64e68e0 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:40.535809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38da7f7-2090-4a0e-924d-6a17e64e68e0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:40.536355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38da7f7-2090-4a0e-924d-6a17e64e68e0 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:40.537769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 532/1021] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:40.543219 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1f4ba-6223-444f-870c-27547d671be5 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:40.543550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1f4ba-6223-444f-870c-27547d671be5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:40.543836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1f4ba-6223-444f-870c-27547d671be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:40.561019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-17d1f4ba-6223-444f-870c-27547d671be5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:40.562743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-17d1f4ba-6223-444f-870c-27547d671be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:40.639042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 490/1022] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:40.663839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38da7f7-2090-4a0e-924d-6a17e64e68e0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:40.726983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:40.771778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38da7f7-2090-4a0e-924d-6a17e64e68e0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:40.805918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ec116-0f54-4c6b-b130-6c5e5e0133ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:40.806719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ec116-0f54-4c6b-b130-6c5e5e0133ac None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:40.807000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ec116-0f54-4c6b-b130-6c5e5e0133ac None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:40.807275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ec116-0f54-4c6b-b130-6c5e5e0133ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:40.808492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ec116-0f54-4c6b-b130-6c5e5e0133ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:40.809913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ec116-0f54-4c6b-b130-6c5e5e0133ac None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:40.816648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 533/1023] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:40.817975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1f4ba-6223-444f-870c-27547d671be5 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:40.909054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:40.923043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1f4ba-6223-444f-870c-27547d671be5 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:40.959108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06eacc-7510-475d-9927-abc7fa7d2a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:40.959857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06eacc-7510-475d-9927-abc7fa7d2a39 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:40.960140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06eacc-7510-475d-9927-abc7fa7d2a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:40.960419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06eacc-7510-475d-9927-abc7fa7d2a39 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:40.961172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06eacc-7510-475d-9927-abc7fa7d2a39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:40.962662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06eacc-7510-475d-9927-abc7fa7d2a39 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:40.986661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 491/1024] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:09:40 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:09:41.298364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a9a7f-1895-4dd0-845e-a74ce15ef0c9 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:41.298683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a9a7f-1895-4dd0-845e-a74ce15ef0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:41.298931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a9a7f-1895-4dd0-845e-a74ce15ef0c9 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:41.300495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 534/1025] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:41.305613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d03a-8ae0-4c7f-beab-868bbae7baaf None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:41.306034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d03a-8ae0-4c7f-beab-868bbae7baaf None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:41.306192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77d03a-8ae0-4c7f-beab-868bbae7baaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:41.323653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4a77d03a-8ae0-4c7f-beab-868bbae7baaf None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:41.324853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4a77d03a-8ae0-4c7f-beab-868bbae7baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:41.392829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 492/1026] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:41.415174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a9a7f-1895-4dd0-845e-a74ce15ef0c9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:41.528522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a9a7f-1895-4dd0-845e-a74ce15ef0c9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:41.555618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:41.565643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad189-7dba-442d-9d7f-85d441211c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:41.566435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad189-7dba-442d-9d7f-85d441211c4d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:41.566718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad189-7dba-442d-9d7f-85d441211c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:41.566994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ad189-7dba-442d-9d7f-85d441211c4d None admin] PATH_INFO: `/v3/services/image` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:41.567685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ad189-7dba-442d-9d7f-85d441211c4d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:41.569042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ad189-7dba-442d-9d7f-85d441211c4d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d82ad189-7dba-442d-9d7f-85d441211c4d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:41.580938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:41.581942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:09:41.582805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:41.587170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 535/1027] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Jun 7 14:09:41 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:41.588606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d03a-8ae0-4c7f-beab-868bbae7baaf None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:41.662472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:41.689724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77d03a-8ae0-4c7f-beab-868bbae7baaf None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:41.723207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31375c37-c86f-4214-a5fe-be8354b90853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:41.723905 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31375c37-c86f-4214-a5fe-be8354b90853 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:41.724192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31375c37-c86f-4214-a5fe-be8354b90853 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:41.724469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31375c37-c86f-4214-a5fe-be8354b90853 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:41.725184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31375c37-c86f-4214-a5fe-be8354b90853 None admin] RBAC: Adding query filter params (name=image) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:41.725493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31375c37-c86f-4214-a5fe-be8354b90853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:41.726859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31375c37-c86f-4214-a5fe-be8354b90853 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:41.736689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 493/1028] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:41.737943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad189-7dba-442d-9d7f-85d441211c4d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:41.837824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ad189-7dba-442d-9d7f-85d441211c4d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:41.871919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37aa46-59d3-4fd9-bb36-231259e85d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:41.872582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37aa46-59d3-4fd9-bb36-231259e85d50 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:41.872868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37aa46-59d3-4fd9-bb36-231259e85d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:41.873146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37aa46-59d3-4fd9-bb36-231259e85d50 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:41.873863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37aa46-59d3-4fd9-bb36-231259e85d50 None admin] RBAC: Adding query filter params (type=image) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:41.874171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37aa46-59d3-4fd9-bb36-231259e85d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:41.875585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37aa46-59d3-4fd9-bb36-231259e85d50 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:41.885182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 536/1029] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:41.886374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31375c37-c86f-4214-a5fe-be8354b90853 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:41.985650 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31375c37-c86f-4214-a5fe-be8354b90853 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:42.018873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9e4f0-b20b-4f6d-b20f-3703f834c15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:42.019560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9e4f0-b20b-4f6d-b20f-3703f834c15e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:42.019846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9e4f0-b20b-4f6d-b20f-3703f834c15e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:42.020127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9e4f0-b20b-4f6d-b20f-3703f834c15e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:42.020919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9e4f0-b20b-4f6d-b20f-3703f834c15e None admin] RBAC: Adding query filter params (interface=public, service_id=afc5a845ebe548fd9b40d39b2a55f25c, region_id=RegionOne) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:42.021233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9e4f0-b20b-4f6d-b20f-3703f834c15e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:42.022597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9e4f0-b20b-4f6d-b20f-3703f834c15e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:42.032673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 494/1030] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jun 7 14:09:41 2022] GET /identity/v3/endpoints?service_id=afc5a845ebe548fd9b40d39b2a55f25c&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:42.033905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37aa46-59d3-4fd9-bb36-231259e85d50 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:42.090177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:42.146013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37aa46-59d3-4fd9-bb36-231259e85d50 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:42.183908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fde2f-105d-4812-8b61-9e6a419e49be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:42.184589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fde2f-105d-4812-8b61-9e6a419e49be None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:42.184875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fde2f-105d-4812-8b61-9e6a419e49be None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:42.185153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fde2f-105d-4812-8b61-9e6a419e49be None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:42.185850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fde2f-105d-4812-8b61-9e6a419e49be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:42.187247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fde2f-105d-4812-8b61-9e6a419e49be None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:42.199406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 537/1031] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jun 7 14:09:42 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:09:42.594895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c441cb-8955-4a54-b1fb-60e2e21c8136 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:42.595432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c441cb-8955-4a54-b1fb-60e2e21c8136 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:42.595516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c441cb-8955-4a54-b1fb-60e2e21c8136 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:42.596887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 495/1032] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:42.602033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefb79b-4770-4d56-b599-4078f45cf8b5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:42.602453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefb79b-4770-4d56-b599-4078f45cf8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:42.602669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefb79b-4770-4d56-b599-4078f45cf8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:42.619317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-cbefb79b-4770-4d56-b599-4078f45cf8b5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:42.620540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cbefb79b-4770-4d56-b599-4078f45cf8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:42.691375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 538/1033] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:42.712123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c441cb-8955-4a54-b1fb-60e2e21c8136 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:42.715093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:42.819817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c441cb-8955-4a54-b1fb-60e2e21c8136 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:42.853705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15a7df-11a1-455f-9834-9c6b60a34e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:42.854516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15a7df-11a1-455f-9834-9c6b60a34e7e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:42.854802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15a7df-11a1-455f-9834-9c6b60a34e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:42.855130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15a7df-11a1-455f-9834-9c6b60a34e7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:42.865106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15a7df-11a1-455f-9834-9c6b60a34e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-8d15a7df-11a1-455f-9834-9c6b60a34e7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:42.873176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:42.874102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:42.875869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:42.879696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 496/1034] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jun 7 14:09:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:42.880791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefb79b-4770-4d56-b599-4078f45cf8b5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:42.930686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:42.984894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefb79b-4770-4d56-b599-4078f45cf8b5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:43.020051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15dc33-0476-4065-a3f6-d693d63c212f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:43.020717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15dc33-0476-4065-a3f6-d693d63c212f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.021003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15dc33-0476-4065-a3f6-d693d63c212f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.021278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15dc33-0476-4065-a3f6-d693d63c212f None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.022019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15dc33-0476-4065-a3f6-d693d63c212f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:43.022321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15dc33-0476-4065-a3f6-d693d63c212f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:43.023762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15dc33-0476-4065-a3f6-d693d63c212f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:43.036244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 539/1035] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jun 7 14:09:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:43.037388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15a7df-11a1-455f-9834-9c6b60a34e7e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:43.100095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:43.141169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15a7df-11a1-455f-9834-9c6b60a34e7e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:43.174103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23690a-65e4-46b0-9612-762d0ef8d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:43.174891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23690a-65e4-46b0-9612-762d0ef8d049 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.175167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23690a-65e4-46b0-9612-762d0ef8d049 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.175460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23690a-65e4-46b0-9612-762d0ef8d049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.185805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23690a-65e4-46b0-9612-762d0ef8d049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:43.187898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23690a-65e4-46b0-9612-762d0ef8d049 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-fd23690a-65e4-46b0-9612-762d0ef8d049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:43.204667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:43.205559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:43.211117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:43.211117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:43.211117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:43.211117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:43.211117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 497/1036] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:43.212499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15dc33-0476-4065-a3f6-d693d63c212f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:43.302661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5e4f3-728b-4aba-8e92-e915a9472409 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.303004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5e4f3-728b-4aba-8e92-e915a9472409 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.303224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5e4f3-728b-4aba-8e92-e915a9472409 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.304754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 498/1037] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:43.309446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94046ccc-3344-419b-a6f5-009e5bad6c91 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.309735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94046ccc-3344-419b-a6f5-009e5bad6c91 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.310016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94046ccc-3344-419b-a6f5-009e5bad6c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.318397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15dc33-0476-4065-a3f6-d693d63c212f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:43.327043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-94046ccc-3344-419b-a6f5-009e5bad6c91 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:43.328303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-94046ccc-3344-419b-a6f5-009e5bad6c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:43.333409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:43.360019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac5950-6347-499d-a18f-733a9a55e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:43.360610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5950-6347-499d-a18f-733a9a55e990 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.360896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5950-6347-499d-a18f-733a9a55e990 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.361173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5950-6347-499d-a18f-733a9a55e990 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.361915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5950-6347-499d-a18f-733a9a55e990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:43.362222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5950-6347-499d-a18f-733a9a55e990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:43.363643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5950-6347-499d-a18f-733a9a55e990 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:43.380121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 540/1038] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:43.381352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac5950-6347-499d-a18f-733a9a55e990 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:43.408493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 499/1039] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:43.433496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94046ccc-3344-419b-a6f5-009e5bad6c91 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:43.486984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:43.490403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac5950-6347-499d-a18f-733a9a55e990 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:43.527845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347c2ce-14e8-4024-a2fb-cdfaa9c1dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:43.528646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347c2ce-14e8-4024-a2fb-cdfaa9c1dace None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.528933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347c2ce-14e8-4024-a2fb-cdfaa9c1dace None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.529211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347c2ce-14e8-4024-a2fb-cdfaa9c1dace None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.537563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347c2ce-14e8-4024-a2fb-cdfaa9c1dace None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:43.538985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347c2ce-14e8-4024-a2fb-cdfaa9c1dace None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:43.544661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94046ccc-3344-419b-a6f5-009e5bad6c91 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6347c2ce-14e8-4024-a2fb-cdfaa9c1dace None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:43.555183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:43.556334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:43.557329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 541/1040] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jun 7 14:09:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:43.562083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347c2ce-14e8-4024-a2fb-cdfaa9c1dace None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:43.583019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2074e9f-82af-4ec6-9e4c-973c1eb0b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:43.583958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2074e9f-82af-4ec6-9e4c-973c1eb0b44a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.584240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2074e9f-82af-4ec6-9e4c-973c1eb0b44a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.584519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2074e9f-82af-4ec6-9e4c-973c1eb0b44a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.593709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:43.596311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2074e9f-82af-4ec6-9e4c-973c1eb0b44a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-f2074e9f-82af-4ec6-9e4c-973c1eb0b44a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:43.605450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:43.606465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:43.607376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 500/1041] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:43.613210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2074e9f-82af-4ec6-9e4c-973c1eb0b44a None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:43.672216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347c2ce-14e8-4024-a2fb-cdfaa9c1dace None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:43.708184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0408e3-9464-4eb2-8783-516bcb9453b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:43.708851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0408e3-9464-4eb2-8783-516bcb9453b6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.709135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0408e3-9464-4eb2-8783-516bcb9453b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.709409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0408e3-9464-4eb2-8783-516bcb9453b6 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.710246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0408e3-9464-4eb2-8783-516bcb9453b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:43.710556 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0408e3-9464-4eb2-8783-516bcb9453b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:43.712014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0408e3-9464-4eb2-8783-516bcb9453b6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:43.719484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2074e9f-82af-4ec6-9e4c-973c1eb0b44a None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:43.721857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:43.729800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 542/1042] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jun 7 14:09:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:43.735539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0408e3-9464-4eb2-8783-516bcb9453b6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:43.756755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f5190-7507-4b10-8f95-23b17dc2a39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:43.757485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f5190-7507-4b10-8f95-23b17dc2a39e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.757820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f5190-7507-4b10-8f95-23b17dc2a39e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.758154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f5190-7507-4b10-8f95-23b17dc2a39e None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.758921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f5190-7507-4b10-8f95-23b17dc2a39e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:43.759236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f5190-7507-4b10-8f95-23b17dc2a39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:43.760644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f5190-7507-4b10-8f95-23b17dc2a39e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:43.769397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 501/1043] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:43.774941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f5190-7507-4b10-8f95-23b17dc2a39e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:43.838316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:43.850536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0408e3-9464-4eb2-8783-516bcb9453b6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:43.880099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f5190-7507-4b10-8f95-23b17dc2a39e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:43.885518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1852e-2945-4382-8af7-cc7d951efc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:43.886170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1852e-2945-4382-8af7-cc7d951efc71 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.886455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1852e-2945-4382-8af7-cc7d951efc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.886731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1852e-2945-4382-8af7-cc7d951efc71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.915361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92579-ae91-4f38-8793-d8efbfba03d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:43.916265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92579-ae91-4f38-8793-d8efbfba03d6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:43.916550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92579-ae91-4f38-8793-d8efbfba03d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:43.916822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92579-ae91-4f38-8793-d8efbfba03d6 None admin] PATH_INFO: `/v3/users/fe3c3972d0ce48618376b7ca8e2365c4` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:43.931412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c92579-ae91-4f38-8793-d8efbfba03d6 None admin] RBAC: Authorizing `identity:get_user(user_id=fe3c3972d0ce48618376b7ca8e2365c4)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:43.932926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c92579-ae91-4f38-8793-d8efbfba03d6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:43.934845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 502/1044] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:09:43 2022] GET /identity/v3/users/fe3c3972d0ce48618376b7ca8e2365c4 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:43.940252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92579-ae91-4f38-8793-d8efbfba03d6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:43.961593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1852e-2945-4382-8af7-cc7d951efc71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:43.963747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a1852e-2945-4382-8af7-cc7d951efc71 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:43.965657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:44.047846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92579-ae91-4f38-8793-d8efbfba03d6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:44.059117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:44.070804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 543/1045] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:09:44.076855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1852e-2945-4382-8af7-cc7d951efc71 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:44.086422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3231b4-25e8-454c-81fe-bdfde1893ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:44.087084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3231b4-25e8-454c-81fe-bdfde1893ebe None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.087391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3231b4-25e8-454c-81fe-bdfde1893ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.087735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3231b4-25e8-454c-81fe-bdfde1893ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.165393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3231b4-25e8-454c-81fe-bdfde1893ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:44.166827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3231b4-25e8-454c-81fe-bdfde1893ebe None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:44.185889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a1852e-2945-4382-8af7-cc7d951efc71 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:44.194363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:44.224418 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b861-f402-46a0-b209-c9a802adb862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:44.225459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b861-f402-46a0-b209-c9a802adb862 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.225883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b861-f402-46a0-b209-c9a802adb862 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.226295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b861-f402-46a0-b209-c9a802adb862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.237396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b861-f402-46a0-b209-c9a802adb862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:44.238817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b861-f402-46a0-b209-c9a802adb862 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f686b861-f402-46a0-b209-c9a802adb862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:44.258440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:44.259444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:44.260669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:44.260669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:44.260669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:44.260669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:44.260669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 544/1046] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:44.265918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b861-f402-46a0-b209-c9a802adb862 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:44.283502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 503/1047] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:09:44.284800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3231b4-25e8-454c-81fe-bdfde1893ebe None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:44.310262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:44.370252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b861-f402-46a0-b209-c9a802adb862 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:44.388814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3231b4-25e8-454c-81fe-bdfde1893ebe None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:44.404735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9192080-b33f-4547-abce-8cf1fee3232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:44.405459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9192080-b33f-4547-abce-8cf1fee3232a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.405749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9192080-b33f-4547-abce-8cf1fee3232a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.405946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9192080-b33f-4547-abce-8cf1fee3232a None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.406718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9192080-b33f-4547-abce-8cf1fee3232a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:44.407025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9192080-b33f-4547-abce-8cf1fee3232a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:44.408415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9192080-b33f-4547-abce-8cf1fee3232a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:44.414446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:44.420643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 545/1048] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:44.426351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9192080-b33f-4547-abce-8cf1fee3232a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:44.430553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc8e8-d15f-4dc4-b17d-282a74d54b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:44.431458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc8e8-d15f-4dc4-b17d-282a74d54b01 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.431743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc8e8-d15f-4dc4-b17d-282a74d54b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.432018 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc8e8-d15f-4dc4-b17d-282a74d54b01 None admin] PATH_INFO: `/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.433226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdc8e8-d15f-4dc4-b17d-282a74d54b01 None admin] RBAC: Authorizing `identity:get_project(project_id=fd6a8369958b43cfabd4a2af0ed37c65)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:44.434643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdc8e8-d15f-4dc4-b17d-282a74d54b01 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:44.441858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 504/1049] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:09:44 2022] GET /identity/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:44.442671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc8e8-d15f-4dc4-b17d-282a74d54b01 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:44.545975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc8e8-d15f-4dc4-b17d-282a74d54b01 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:44.548698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9192080-b33f-4547-abce-8cf1fee3232a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:44.550272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:44.581679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a4a64-9cb6-4256-ab50-dd10ed2322ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:44.582542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a4a64-9cb6-4256-ab50-dd10ed2322ba None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.582827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a4a64-9cb6-4256-ab50-dd10ed2322ba None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.583100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a4a64-9cb6-4256-ab50-dd10ed2322ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.583226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc81816-ad32-4359-b1c3-affd11c47f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:44.583970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a4a64-9cb6-4256-ab50-dd10ed2322ba None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=fd6a8369958b43cfabd4a2af0ed37c65, user.id=fe3c3972d0ce48618376b7ca8e2365c4) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:44.584068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc81816-ad32-4359-b1c3-affd11c47f72 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.584255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc81816-ad32-4359-b1c3-affd11c47f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.584361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a4a64-9cb6-4256-ab50-dd10ed2322ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:44.584534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc81816-ad32-4359-b1c3-affd11c47f72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.585684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a4a64-9cb6-4256-ab50-dd10ed2322ba None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:44.591075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 505/1050] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:44 2022] GET /identity/v3/role_assignments?user.id=fe3c3972d0ce48618376b7ca8e2365c4&scope.project.id=fd6a8369958b43cfabd4a2af0ed37c65&role.id=c6577847f998435991dac5744a94d0ee => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:44.591197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc81816-ad32-4359-b1c3-affd11c47f72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:44.592314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816b9e5-4de2-449d-a566-ca9e054a5455 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.592598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816b9e5-4de2-449d-a566-ca9e054a5455 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.592708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc81816-ad32-4359-b1c3-affd11c47f72 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:44.592874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816b9e5-4de2-449d-a566-ca9e054a5455 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.598431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 506/1051] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:44.599789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd41f2-8b8e-45d7-96ed-61eb02dcb4f5 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.600091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd41f2-8b8e-45d7-96ed-61eb02dcb4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.600375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd41f2-8b8e-45d7-96ed-61eb02dcb4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-cfc81816-ad32-4359-b1c3-affd11c47f72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:44.614195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:44.615177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:44.616126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:44.616126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:44.616126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:44.616126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:44.616126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:44.616126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:44.616126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:44.616126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:44.616126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 546/1052] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:44.621513 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc81816-ad32-4359-b1c3-affd11c47f72 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:44.623699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-29fd41f2-8b8e-45d7-96ed-61eb02dcb4f5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:44.625563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-29fd41f2-8b8e-45d7-96ed-61eb02dcb4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:44.685199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:44.705360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 507/1053] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:44.728273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd41f2-8b8e-45d7-96ed-61eb02dcb4f5 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:44.737709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc81816-ad32-4359-b1c3-affd11c47f72 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:44.778397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0eda-ad60-45b3-9310-e5e5e8ed4279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:44.779397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0eda-ad60-45b3-9310-e5e5e8ed4279 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.779821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0eda-ad60-45b3-9310-e5e5e8ed4279 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.780108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0eda-ad60-45b3-9310-e5e5e8ed4279 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.781426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0eda-ad60-45b3-9310-e5e5e8ed4279 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:44.781740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0eda-ad60-45b3-9310-e5e5e8ed4279 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:44.783200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0eda-ad60-45b3-9310-e5e5e8ed4279 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:44.799380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 547/1054] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:44.802464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0eda-ad60-45b3-9310-e5e5e8ed4279 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:44.834877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:44.840881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd41f2-8b8e-45d7-96ed-61eb02dcb4f5 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:44.877851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5d222-fc61-4643-900f-4832b4602fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:44.878669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5d222-fc61-4643-900f-4832b4602fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.878924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5d222-fc61-4643-900f-4832b4602fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.879192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5d222-fc61-4643-900f-4832b4602fa6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.879878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5d222-fc61-4643-900f-4832b4602fa6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:44.881248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5d222-fc61-4643-900f-4832b4602fa6 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-16e5d222-fc61-4643-900f-4832b4602fa6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:44.892704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:44.893704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:44.894548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 508/1055] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Jun 7 14:09:44 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:44.900088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5d222-fc61-4643-900f-4832b4602fa6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:44.917634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0eda-ad60-45b3-9310-e5e5e8ed4279 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:44.953041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:44.954295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cf51b-6613-4f76-aec8-e92a33c5e289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:44.954926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cf51b-6613-4f76-aec8-e92a33c5e289 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:44.955264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cf51b-6613-4f76-aec8-e92a33c5e289 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:44.955500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cf51b-6613-4f76-aec8-e92a33c5e289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:44.956330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cf51b-6613-4f76-aec8-e92a33c5e289 None admin] RBAC: Adding query filter params (role.id=a2fad9c023754ad5b921d75bf26d9efc, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=e1ea02cd5e644aaba236acf4e46cb20f) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:44.956643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cf51b-6613-4f76-aec8-e92a33c5e289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:44.958053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cf51b-6613-4f76-aec8-e92a33c5e289 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:44.975390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 548/1056] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:44 2022] GET /identity/v3/role_assignments?user.id=e1ea02cd5e644aaba236acf4e46cb20f&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=a2fad9c023754ad5b921d75bf26d9efc => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:45.022033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5d222-fc61-4643-900f-4832b4602fa6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:45.059511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54221c02-4241-45c9-8b11-f820e678ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:45.060201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54221c02-4241-45c9-8b11-f820e678ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:45.060485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54221c02-4241-45c9-8b11-f820e678ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:45.060764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54221c02-4241-45c9-8b11-f820e678ecc9 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:45.061494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54221c02-4241-45c9-8b11-f820e678ecc9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:45.061801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54221c02-4241-45c9-8b11-f820e678ecc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:45.063229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54221c02-4241-45c9-8b11-f820e678ecc9 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:45.072043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 509/1057] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:45.074907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cf51b-6613-4f76-aec8-e92a33c5e289 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:45.169339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:45.185272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cf51b-6613-4f76-aec8-e92a33c5e289 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:45.220758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e76cd-8805-4886-826c-ebcd5759a364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:45.221710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e76cd-8805-4886-826c-ebcd5759a364 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:45.222227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e76cd-8805-4886-826c-ebcd5759a364 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:45.222704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e76cd-8805-4886-826c-ebcd5759a364 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:45.223658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e76cd-8805-4886-826c-ebcd5759a364 None admin] RBAC: Adding query filter params (type=image) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:45.224168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e76cd-8805-4886-826c-ebcd5759a364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:45.225721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e76cd-8805-4886-826c-ebcd5759a364 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:45.235371 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 549/1058] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:45.236965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54221c02-4241-45c9-8b11-f820e678ecc9 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:45.340999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54221c02-4241-45c9-8b11-f820e678ecc9 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:45.355798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:45.377017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a734d9-6b49-44ba-911a-760f9955457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:45.378021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a734d9-6b49-44ba-911a-760f9955457b None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:45.378525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a734d9-6b49-44ba-911a-760f9955457b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:45.378998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a734d9-6b49-44ba-911a-760f9955457b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:45.379975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a734d9-6b49-44ba-911a-760f9955457b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:45.381529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a734d9-6b49-44ba-911a-760f9955457b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:45.405688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 510/1059] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jun 7 14:09:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:09:46.830763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef8e28-2faa-454f-8e56-9639a6cade2f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:46.831301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef8e28-2faa-454f-8e56-9639a6cade2f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:46.831301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef8e28-2faa-454f-8e56-9639a6cade2f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:46.832673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 550/1060] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:46.837803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1ace-3210-4b01-8d89-12af8a3230d1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:46.838212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1ace-3210-4b01-8d89-12af8a3230d1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:46.838407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de1ace-3210-4b01-8d89-12af8a3230d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:46.855567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-42de1ace-3210-4b01-8d89-12af8a3230d1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:46.856754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-42de1ace-3210-4b01-8d89-12af8a3230d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:46.935888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 511/1061] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:46.958405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef8e28-2faa-454f-8e56-9639a6cade2f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:47.060478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef8e28-2faa-454f-8e56-9639a6cade2f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:47.094973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af807734-9cb5-4290-b6ad-ba23aed713fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:47.095723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af807734-9cb5-4290-b6ad-ba23aed713fc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.096010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af807734-9cb5-4290-b6ad-ba23aed713fc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.096286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af807734-9cb5-4290-b6ad-ba23aed713fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.106951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af807734-9cb5-4290-b6ad-ba23aed713fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-af807734-9cb5-4290-b6ad-ba23aed713fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:47.114616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:47.115853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:47.116783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:47.119677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 551/1062] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:47.121726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1ace-3210-4b01-8d89-12af8a3230d1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:47.216937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:47.224123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de1ace-3210-4b01-8d89-12af8a3230d1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:47.229834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3183f-211a-4078-aba2-a2280ad84470 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.230126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3183f-211a-4078-aba2-a2280ad84470 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.230406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3183f-211a-4078-aba2-a2280ad84470 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.231959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 552/1063] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:47.236647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce40a6-0b96-4f91-8c48-5fffddd54c43 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.236940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce40a6-0b96-4f91-8c48-5fffddd54c43 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.237221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce40a6-0b96-4f91-8c48-5fffddd54c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.255380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-31ce40a6-0b96-4f91-8c48-5fffddd54c43 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:47.256789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-31ce40a6-0b96-4f91-8c48-5fffddd54c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:47.259665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:47.261568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f77f99-4f52-41b7-ae27-2c6e9ecab596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:47.262295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f77f99-4f52-41b7-ae27-2c6e9ecab596 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.262595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f77f99-4f52-41b7-ae27-2c6e9ecab596 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.262864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f77f99-4f52-41b7-ae27-2c6e9ecab596 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.263662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f77f99-4f52-41b7-ae27-2c6e9ecab596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:47.263978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f77f99-4f52-41b7-ae27-2c6e9ecab596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:47.265424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f77f99-4f52-41b7-ae27-2c6e9ecab596 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:47.278945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 512/1064] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:47.279971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f77f99-4f52-41b7-ae27-2c6e9ecab596 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:47.344022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 553/1065] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:47.366338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce40a6-0b96-4f91-8c48-5fffddd54c43 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:47.389932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f77f99-4f52-41b7-ae27-2c6e9ecab596 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:47.426299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0edc5-e5db-44dc-85e0-47016ab6e77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:47.427202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0edc5-e5db-44dc-85e0-47016ab6e77d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.427536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0edc5-e5db-44dc-85e0-47016ab6e77d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.427822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0edc5-e5db-44dc-85e0-47016ab6e77d None admin] PATH_INFO: `/v3/users/fe3c3972d0ce48618376b7ca8e2365c4` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.429107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0edc5-e5db-44dc-85e0-47016ab6e77d None admin] RBAC: Authorizing `identity:get_user(user_id=fe3c3972d0ce48618376b7ca8e2365c4)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:47.430555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0edc5-e5db-44dc-85e0-47016ab6e77d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:47.432290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 513/1066] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:09:47 2022] GET /identity/v3/users/fe3c3972d0ce48618376b7ca8e2365c4 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:47.438354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0edc5-e5db-44dc-85e0-47016ab6e77d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:47.470471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:47.484989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce40a6-0b96-4f91-8c48-5fffddd54c43 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:47.521794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0fca2-0cde-41ba-9b37-ab4ca684e206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:47.522619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0fca2-0cde-41ba-9b37-ab4ca684e206 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.522904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0fca2-0cde-41ba-9b37-ab4ca684e206 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.523185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0fca2-0cde-41ba-9b37-ab4ca684e206 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.531829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:47.535487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0fca2-0cde-41ba-9b37-ab4ca684e206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-09a0fca2-0cde-41ba-9b37-ab4ca684e206 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:47.544702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:47.545891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:47.547305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:47.551403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 554/1067] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jun 7 14:09:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:47.552252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0fca2-0cde-41ba-9b37-ab4ca684e206 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:47.561914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0edc5-e5db-44dc-85e0-47016ab6e77d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:47.598344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e84ed-3336-45d3-9ae2-fb4a8a585931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:47.599201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e84ed-3336-45d3-9ae2-fb4a8a585931 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.599517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e84ed-3336-45d3-9ae2-fb4a8a585931 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.599834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e84ed-3336-45d3-9ae2-fb4a8a585931 None admin] PATH_INFO: `/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.601097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e84ed-3336-45d3-9ae2-fb4a8a585931 None admin] RBAC: Authorizing `identity:get_project(project_id=fd6a8369958b43cfabd4a2af0ed37c65)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:47.602529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e84ed-3336-45d3-9ae2-fb4a8a585931 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:47.608950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 514/1068] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:09:47 2022] GET /identity/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:47.610476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e84ed-3336-45d3-9ae2-fb4a8a585931 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:47.661892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0fca2-0cde-41ba-9b37-ab4ca684e206 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:47.695353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb0eef-2b78-4ad0-8a58-8e506ba3165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:47.696020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb0eef-2b78-4ad0-8a58-8e506ba3165e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.696299 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb0eef-2b78-4ad0-8a58-8e506ba3165e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.696575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb0eef-2b78-4ad0-8a58-8e506ba3165e None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.697577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb0eef-2b78-4ad0-8a58-8e506ba3165e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:47.697880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb0eef-2b78-4ad0-8a58-8e506ba3165e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:47.699219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb0eef-2b78-4ad0-8a58-8e506ba3165e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:47.705483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:47.707109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 555/1069] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jun 7 14:09:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:47.708367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d452e15-0222-4575-ad69-517187e9d4fa None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.708655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d452e15-0222-4575-ad69-517187e9d4fa None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.708937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d452e15-0222-4575-ad69-517187e9d4fa None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.713243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e84ed-3336-45d3-9ae2-fb4a8a585931 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:47.714210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 556/1070] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:47.715000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d452e15-0222-4575-ad69-517187e9d4fa None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:47.747128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd72a3-be17-40c6-817f-348d1b9ec1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:47.748045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd72a3-be17-40c6-817f-348d1b9ec1e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.748332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd72a3-be17-40c6-817f-348d1b9ec1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.748615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd72a3-be17-40c6-817f-348d1b9ec1e7 None admin] PATH_INFO: `/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65/users/fe3c3972d0ce48618376b7ca8e2365c4/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.751242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd72a3-be17-40c6-817f-348d1b9ec1e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd6a8369958b43cfabd4a2af0ed37c65, user_id=fe3c3972d0ce48618376b7ca8e2365c4, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:47.752725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd72a3-be17-40c6-817f-348d1b9ec1e7 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:47.765460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 515/1071] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:09:47 2022] PUT /identity/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65/users/fe3c3972d0ce48618376b7ca8e2365c4/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:09:47.766662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bb21a-8f47-4a34-bf39-97dbc44c9cc7 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.766950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bb21a-8f47-4a34-bf39-97dbc44c9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.767226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bb21a-8f47-4a34-bf39-97dbc44c9cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.785920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:47.799230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-556bb21a-8f47-4a34-bf39-97dbc44c9cc7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:47.800522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-556bb21a-8f47-4a34-bf39-97dbc44c9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:47.831973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d452e15-0222-4575-ad69-517187e9d4fa None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:47.871426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8020-a430-4d3c-b41d-926d837bf184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:47.872264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8020-a430-4d3c-b41d-926d837bf184 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:47.872552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8020-a430-4d3c-b41d-926d837bf184 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:47.872832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db8020-a430-4d3c-b41d-926d837bf184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:47.878845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 516/1072] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:47.891031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db8020-a430-4d3c-b41d-926d837bf184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:47.892624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db8020-a430-4d3c-b41d-926d837bf184 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:47.900967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bb21a-8f47-4a34-bf39-97dbc44c9cc7 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b9db8020-a430-4d3c-b41d-926d837bf184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:47.912220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:47.913231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:47.914167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:47.914167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:47.914167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:47.914167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:47.914167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 557/1073] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:47.919588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8020-a430-4d3c-b41d-926d837bf184 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:48.006050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:48.024356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bb21a-8f47-4a34-bf39-97dbc44c9cc7 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:48.030091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db8020-a430-4d3c-b41d-926d837bf184 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:48.045124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:48.060223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444401d6-9dd2-4f5a-a30b-51d6bc6f4faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:48.060874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444401d6-9dd2-4f5a-a30b-51d6bc6f4faf None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:48.061163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444401d6-9dd2-4f5a-a30b-51d6bc6f4faf None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:48.061434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444401d6-9dd2-4f5a-a30b-51d6bc6f4faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:48.068191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4acfb-b359-445c-9410-e34ab32a94cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:48.068860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4acfb-b359-445c-9410-e34ab32a94cd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:48.069146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4acfb-b359-445c-9410-e34ab32a94cd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:48.069425 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4acfb-b359-445c-9410-e34ab32a94cd None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:48.070160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4acfb-b359-445c-9410-e34ab32a94cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:48.070703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4acfb-b359-445c-9410-e34ab32a94cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:48.071866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4acfb-b359-445c-9410-e34ab32a94cd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:48.085190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 558/1074] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:48.090692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4acfb-b359-445c-9410-e34ab32a94cd None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:48.132134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444401d6-9dd2-4f5a-a30b-51d6bc6f4faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:48.133577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444401d6-9dd2-4f5a-a30b-51d6bc6f4faf None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:48.196640 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4acfb-b359-445c-9410-e34ab32a94cd None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:48.230243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:48.230432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9315c60-110d-47cf-b5cb-4787791a3286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:48.231244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9315c60-110d-47cf-b5cb-4787791a3286 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:48.231532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9315c60-110d-47cf-b5cb-4787791a3286 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:48.231644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9315c60-110d-47cf-b5cb-4787791a3286 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:48.240737 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9315c60-110d-47cf-b5cb-4787791a3286 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:48.242165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9315c60-110d-47cf-b5cb-4787791a3286 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:48.250799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 517/1075] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:09:48.256566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444401d6-9dd2-4f5a-a30b-51d6bc6f4faf None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d9315c60-110d-47cf-b5cb-4787791a3286 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:48.258278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:48.259448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:48.260508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 559/1076] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jun 7 14:09:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:48.265210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9315c60-110d-47cf-b5cb-4787791a3286 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:48.300684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:48.368069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444401d6-9dd2-4f5a-a30b-51d6bc6f4faf None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:48.371090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9315c60-110d-47cf-b5cb-4787791a3286 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:48.406085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f4ad1-6525-4ef6-a14e-493bf297d4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:48.406762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f4ad1-6525-4ef6-a14e-493bf297d4eb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:48.407050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f4ad1-6525-4ef6-a14e-493bf297d4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:48.407358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f4ad1-6525-4ef6-a14e-493bf297d4eb None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:48.407622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3694-f01f-4f15-9f3b-6e961e2378a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:48.408197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f4ad1-6525-4ef6-a14e-493bf297d4eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:48.408401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3694-f01f-4f15-9f3b-6e961e2378a3 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:48.408497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f4ad1-6525-4ef6-a14e-493bf297d4eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:48.408687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3694-f01f-4f15-9f3b-6e961e2378a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:48.408964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3694-f01f-4f15-9f3b-6e961e2378a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:48.409917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f4ad1-6525-4ef6-a14e-493bf297d4eb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:48.419293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3694-f01f-4f15-9f3b-6e961e2378a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:48.420673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3694-f01f-4f15-9f3b-6e961e2378a3 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:48.432671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 560/1077] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jun 7 14:09:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:48.433738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f4ad1-6525-4ef6-a14e-493bf297d4eb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-87ea3694-f01f-4f15-9f3b-6e961e2378a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:48.444213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:48.445148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:48.446067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:48.446067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:48.446067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:48.446067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:48.446067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 518/1078] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:48.451405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3694-f01f-4f15-9f3b-6e961e2378a3 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:48.497962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:48.535912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:48.547767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f4ad1-6525-4ef6-a14e-493bf297d4eb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:48.571811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3694-f01f-4f15-9f3b-6e961e2378a3 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:48.584541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e182-17c3-4092-9226-98336761868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:48.585334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e182-17c3-4092-9226-98336761868e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:48.585622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e182-17c3-4092-9226-98336761868e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:48.585900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e182-17c3-4092-9226-98336761868e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:48.597627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96e182-17c3-4092-9226-98336761868e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:48.599068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96e182-17c3-4092-9226-98336761868e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:48.609061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a35a5-0f79-49bb-a1ec-4034e30f950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:48.609793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a35a5-0f79-49bb-a1ec-4034e30f950e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:48.610077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a35a5-0f79-49bb-a1ec-4034e30f950e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:48.610352 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a35a5-0f79-49bb-a1ec-4034e30f950e None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:48.611080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a35a5-0f79-49bb-a1ec-4034e30f950e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:48.611414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a35a5-0f79-49bb-a1ec-4034e30f950e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:48.612782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a35a5-0f79-49bb-a1ec-4034e30f950e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8b96e182-17c3-4092-9226-98336761868e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:48.618580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:48.619596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:48.620492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:48.620492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:48.620492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:48.620492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:48.620723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 561/1079] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:48.626658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e182-17c3-4092-9226-98336761868e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:48.629530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 519/1080] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:48.742399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e182-17c3-4092-9226-98336761868e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:48.778714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d132f8a-4d17-4526-a04b-7db408086578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:48.779404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d132f8a-4d17-4526-a04b-7db408086578 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:48.779688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d132f8a-4d17-4526-a04b-7db408086578 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:48.779961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d132f8a-4d17-4526-a04b-7db408086578 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:48.780693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d132f8a-4d17-4526-a04b-7db408086578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:48.780996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d132f8a-4d17-4526-a04b-7db408086578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:48.782898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d132f8a-4d17-4526-a04b-7db408086578 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:48.800506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 562/1081] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:48.801766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a35a5-0f79-49bb-a1ec-4034e30f950e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:48.903671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:48.912092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a35a5-0f79-49bb-a1ec-4034e30f950e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:48.947424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3beef0-e215-4791-8545-b22c0e0760b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:48.948224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3beef0-e215-4791-8545-b22c0e0760b3 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:48.948504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3beef0-e215-4791-8545-b22c0e0760b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:48.948807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3beef0-e215-4791-8545-b22c0e0760b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:48.956226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3beef0-e215-4791-8545-b22c0e0760b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:48.957669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3beef0-e215-4791-8545-b22c0e0760b3 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-8e3beef0-e215-4791-8545-b22c0e0760b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:48.972707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:48.973853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:48.974765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:48.974765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:48.974765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:48.974765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:48.974765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:48.974765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:48.974765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:48.974765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:48.974765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 520/1082] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:48.979671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d132f8a-4d17-4526-a04b-7db408086578 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:48.983477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:49.075675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d132f8a-4d17-4526-a04b-7db408086578 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:49.107668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436c3f7-7dd2-48b3-8d62-2ecb179eebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:49.108313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c3f7-7dd2-48b3-8d62-2ecb179eebd2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:49.108592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c3f7-7dd2-48b3-8d62-2ecb179eebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:49.108865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436c3f7-7dd2-48b3-8d62-2ecb179eebd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:49.110179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436c3f7-7dd2-48b3-8d62-2ecb179eebd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:49.110485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436c3f7-7dd2-48b3-8d62-2ecb179eebd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:49.111913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436c3f7-7dd2-48b3-8d62-2ecb179eebd2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:49.123277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 563/1083] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:49.129638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3beef0-e215-4791-8545-b22c0e0760b3 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:49.226254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3beef0-e215-4791-8545-b22c0e0760b3 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:49.259776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08f8c2-ff00-446c-9c7c-2f0b3f312fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:49.260661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08f8c2-ff00-446c-9c7c-2f0b3f312fa8 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:49.260948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08f8c2-ff00-446c-9c7c-2f0b3f312fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:49.261242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08f8c2-ff00-446c-9c7c-2f0b3f312fa8 None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/e1ea02cd5e644aaba236acf4e46cb20f/roles/a2fad9c023754ad5b921d75bf26d9efc` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:49.263498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08f8c2-ff00-446c-9c7c-2f0b3f312fa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=e1ea02cd5e644aaba236acf4e46cb20f, role_id=a2fad9c023754ad5b921d75bf26d9efc)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:49.264961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08f8c2-ff00-446c-9c7c-2f0b3f312fa8 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:49.277443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 521/1084] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:09:49 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/e1ea02cd5e644aaba236acf4e46cb20f/roles/a2fad9c023754ad5b921d75bf26d9efc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:09:50.028340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbd0c-c344-4a77-9ad0-91e13db88fc1 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:50.028891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbd0c-c344-4a77-9ad0-91e13db88fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:50.028891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cbd0c-c344-4a77-9ad0-91e13db88fc1 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:50.030248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 564/1085] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:50.035709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96295-dc88-47e6-b92b-efbeb25c155f None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:50.036107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96295-dc88-47e6-b92b-efbeb25c155f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:50.036387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f96295-dc88-47e6-b92b-efbeb25c155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:50.052729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-24f96295-dc88-47e6-b92b-efbeb25c155f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:50.053894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-24f96295-dc88-47e6-b92b-efbeb25c155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:50.065010 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:50.119981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 522/1086] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:50.143876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbd0c-c344-4a77-9ad0-91e13db88fc1 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:50.205260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:50.242221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cbd0c-c344-4a77-9ad0-91e13db88fc1 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:50.276443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a0b1-bee0-483f-b8d5-4284e633ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:50.277226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a0b1-bee0-483f-b8d5-4284e633ddec None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:50.277505 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a0b1-bee0-483f-b8d5-4284e633ddec None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:50.277779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8a0b1-bee0-483f-b8d5-4284e633ddec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:50.287538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8a0b1-bee0-483f-b8d5-4284e633ddec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f7e8a0b1-bee0-483f-b8d5-4284e633ddec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:50.294956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:50.295919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:09:50.296846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:50.299495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 565/1087] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:09:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:50.302076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f96295-dc88-47e6-b92b-efbeb25c155f None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:50.402792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f96295-dc88-47e6-b92b-efbeb25c155f None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:50.435837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b0d6f-cacc-46a2-b480-4c0cbfeea1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:50.436510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b0d6f-cacc-46a2-b480-4c0cbfeea1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:50.436796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b0d6f-cacc-46a2-b480-4c0cbfeea1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:50.437076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b0d6f-cacc-46a2-b480-4c0cbfeea1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:50.438402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b0d6f-cacc-46a2-b480-4c0cbfeea1f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:50.438776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b0d6f-cacc-46a2-b480-4c0cbfeea1f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:50.440211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b0d6f-cacc-46a2-b480-4c0cbfeea1f9 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:50.448619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 523/1088] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:09:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:50.454207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a0b1-bee0-483f-b8d5-4284e633ddec None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:50.553105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8a0b1-bee0-483f-b8d5-4284e633ddec None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:50.575875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:50.586509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9303a-d39c-4b22-9ae5-c226e7c1fdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:50.587405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9303a-d39c-4b22-9ae5-c226e7c1fdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:50.587692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9303a-d39c-4b22-9ae5-c226e7c1fdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:50.587968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9303a-d39c-4b22-9ae5-c226e7c1fdf2 None admin] PATH_INFO: `/v3/users/fe3c3972d0ce48618376b7ca8e2365c4` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:50.589143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9303a-d39c-4b22-9ae5-c226e7c1fdf2 None admin] RBAC: Authorizing `identity:get_user(user_id=fe3c3972d0ce48618376b7ca8e2365c4)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:50.590570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9303a-d39c-4b22-9ae5-c226e7c1fdf2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:50.592224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 566/1089] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:09:50 2022] GET /identity/v3/users/fe3c3972d0ce48618376b7ca8e2365c4 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:50.597992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b0d6f-cacc-46a2-b480-4c0cbfeea1f9 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:50.609146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:50.697936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b0d6f-cacc-46a2-b480-4c0cbfeea1f9 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:50.730219 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3c5c-3835-475e-b952-66836c80f88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:50.730866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3c5c-3835-475e-b952-66836c80f88c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:50.731151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3c5c-3835-475e-b952-66836c80f88c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:50.731461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d3c5c-3835-475e-b952-66836c80f88c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:50.798763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d3c5c-3835-475e-b952-66836c80f88c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:50.800248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d3c5c-3835-475e-b952-66836c80f88c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:50.809755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:50.903049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 524/1090] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:09:50.909358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9303a-d39c-4b22-9ae5-c226e7c1fdf2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:51.007152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9303a-d39c-4b22-9ae5-c226e7c1fdf2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:51.039878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8736ae-6a9d-4c86-b87b-1852eed00a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:51.040734 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8736ae-6a9d-4c86-b87b-1852eed00a72 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:51.041018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8736ae-6a9d-4c86-b87b-1852eed00a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:51.041296 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8736ae-6a9d-4c86-b87b-1852eed00a72 None admin] PATH_INFO: `/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:51.042483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8736ae-6a9d-4c86-b87b-1852eed00a72 None admin] RBAC: Authorizing `identity:get_project(project_id=fd6a8369958b43cfabd4a2af0ed37c65)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:51.043954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8736ae-6a9d-4c86-b87b-1852eed00a72 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:51.045868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 567/1091] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:09:50 2022] GET /identity/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:51.052364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3c5c-3835-475e-b952-66836c80f88c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:51.148854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d3c5c-3835-475e-b952-66836c80f88c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:51.159895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:51.185996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725c17-a938-440d-a99b-a61f4f770c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:51.186659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725c17-a938-440d-a99b-a61f4f770c21 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:51.186939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725c17-a938-440d-a99b-a61f4f770c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:51.187212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725c17-a938-440d-a99b-a61f4f770c21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:51.188121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725c17-a938-440d-a99b-a61f4f770c21 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=fd6a8369958b43cfabd4a2af0ed37c65, user.id=fe3c3972d0ce48618376b7ca8e2365c4) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:51.188429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725c17-a938-440d-a99b-a61f4f770c21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:51.189848 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe725c17-a938-440d-a99b-a61f4f770c21 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:51.196099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 525/1092] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:51 2022] GET /identity/v3/role_assignments?user.id=fe3c3972d0ce48618376b7ca8e2365c4&scope.project.id=fd6a8369958b43cfabd4a2af0ed37c65&role.id=c6577847f998435991dac5744a94d0ee => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:51.499070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2318cb9-1a5c-49a1-b7b5-30076d7663b0 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:51.499386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2318cb9-1a5c-49a1-b7b5-30076d7663b0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:51.499671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2318cb9-1a5c-49a1-b7b5-30076d7663b0 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:51.501076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 568/1093] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:51.506316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a2666-2899-4448-8cf3-d120eb191964 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:51.506612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a2666-2899-4448-8cf3-d120eb191964 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:51.506890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a2666-2899-4448-8cf3-d120eb191964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:51.523935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b60a2666-2899-4448-8cf3-d120eb191964 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:51.525114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b60a2666-2899-4448-8cf3-d120eb191964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:51.591458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 526/1094] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:51.615190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2318cb9-1a5c-49a1-b7b5-30076d7663b0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:51.674284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:51.716805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2318cb9-1a5c-49a1-b7b5-30076d7663b0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:51.748869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4d47-b4ac-4ce6-b03b-df4e6de6e406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:51.749608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4d47-b4ac-4ce6-b03b-df4e6de6e406 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:51.749889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4d47-b4ac-4ce6-b03b-df4e6de6e406 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:51.750719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4d47-b4ac-4ce6-b03b-df4e6de6e406 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:51.761115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b4d47-b4ac-4ce6-b03b-df4e6de6e406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-5e7b4d47-b4ac-4ce6-b03b-df4e6de6e406 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:09:51.769855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:51.770850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:51.771795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 569/1095] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jun 7 14:09:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:51.777022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a2666-2899-4448-8cf3-d120eb191964 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:51.872580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a2666-2899-4448-8cf3-d120eb191964 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:51.874087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:51.908085 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910f4c-ec91-4dab-bb50-a849e2f8c47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:51.908747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910f4c-ec91-4dab-bb50-a849e2f8c47d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:51.909027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910f4c-ec91-4dab-bb50-a849e2f8c47d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:51.909297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910f4c-ec91-4dab-bb50-a849e2f8c47d None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:51.910037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910f4c-ec91-4dab-bb50-a849e2f8c47d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:51.910338 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910f4c-ec91-4dab-bb50-a849e2f8c47d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:51.911716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910f4c-ec91-4dab-bb50-a849e2f8c47d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:51.919671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 527/1096] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jun 7 14:09:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:51.925731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4d47-b4ac-4ce6-b03b-df4e6de6e406 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:52.021185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4d47-b4ac-4ce6-b03b-df4e6de6e406 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:52.040628 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:52.055320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae96aab-bc56-4fb7-8909-593a306f22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:52.056136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae96aab-bc56-4fb7-8909-593a306f22aa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:52.056418 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae96aab-bc56-4fb7-8909-593a306f22aa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:52.056690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae96aab-bc56-4fb7-8909-593a306f22aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:52.066980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae96aab-bc56-4fb7-8909-593a306f22aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:52.068432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae96aab-bc56-4fb7-8909-593a306f22aa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-dae96aab-bc56-4fb7-8909-593a306f22aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:52.085851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:52.086902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:52.088007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:52.088007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:52.088007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:52.088007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:52.088007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 570/1097] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:52.092695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910f4c-ec91-4dab-bb50-a849e2f8c47d None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:52.191079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910f4c-ec91-4dab-bb50-a849e2f8c47d None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:52.223733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dd06e-a5f6-4404-a97e-389c76e43eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:52.224396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dd06e-a5f6-4404-a97e-389c76e43eee None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:52.224682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dd06e-a5f6-4404-a97e-389c76e43eee None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:52.224960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dd06e-a5f6-4404-a97e-389c76e43eee None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:52.225685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dd06e-a5f6-4404-a97e-389c76e43eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:52.225992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dd06e-a5f6-4404-a97e-389c76e43eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:52.227388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dd06e-a5f6-4404-a97e-389c76e43eee None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:52.240373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 528/1098] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:52.245624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae96aab-bc56-4fb7-8909-593a306f22aa None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:52.346339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae96aab-bc56-4fb7-8909-593a306f22aa None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:52.379672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38581c96-b41f-4ecc-9002-1e85ac15b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:52.380463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38581c96-b41f-4ecc-9002-1e85ac15b5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:52.380747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38581c96-b41f-4ecc-9002-1e85ac15b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:52.381023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38581c96-b41f-4ecc-9002-1e85ac15b5e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:52.387998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38581c96-b41f-4ecc-9002-1e85ac15b5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:52.389429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38581c96-b41f-4ecc-9002-1e85ac15b5e8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-38581c96-b41f-4ecc-9002-1e85ac15b5e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:09:52.403501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:52.404596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:09:52.406159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 571/1099] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jun 7 14:09:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:52.410854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dd06e-a5f6-4404-a97e-389c76e43eee None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:52.436022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:52.513334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dd06e-a5f6-4404-a97e-389c76e43eee None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:52.546398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599aff-12da-43c9-93e7-0e23a5a24e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:52.547634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599aff-12da-43c9-93e7-0e23a5a24e78 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:52.547919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599aff-12da-43c9-93e7-0e23a5a24e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:52.548193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79599aff-12da-43c9-93e7-0e23a5a24e78 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:52.549028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79599aff-12da-43c9-93e7-0e23a5a24e78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:52.549336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79599aff-12da-43c9-93e7-0e23a5a24e78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:52.550761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79599aff-12da-43c9-93e7-0e23a5a24e78 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:52.572070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 529/1100] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jun 7 14:09:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:52.573490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38581c96-b41f-4ecc-9002-1e85ac15b5e8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:52.603589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:52.670499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38581c96-b41f-4ecc-9002-1e85ac15b5e8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:52.703033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c597db6-89bc-4926-9cdb-2b24782571e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:52.704219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c597db6-89bc-4926-9cdb-2b24782571e2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:52.704503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c597db6-89bc-4926-9cdb-2b24782571e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:52.704781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c597db6-89bc-4926-9cdb-2b24782571e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:52.769972 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c597db6-89bc-4926-9cdb-2b24782571e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:52.771438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c597db6-89bc-4926-9cdb-2b24782571e2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:52.801547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:52.870656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 572/1101] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:09:52.876292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599aff-12da-43c9-93e7-0e23a5a24e78 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:52.956421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:52.975026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79599aff-12da-43c9-93e7-0e23a5a24e78 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:53.008013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62296bdb-f508-4b87-8dca-1ca950508174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:53.008804 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62296bdb-f508-4b87-8dca-1ca950508174 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:53.009082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62296bdb-f508-4b87-8dca-1ca950508174 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:53.009351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62296bdb-f508-4b87-8dca-1ca950508174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:53.019618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62296bdb-f508-4b87-8dca-1ca950508174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:53.021041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62296bdb-f508-4b87-8dca-1ca950508174 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-62296bdb-f508-4b87-8dca-1ca950508174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:09:53.038603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:53.039543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:53.040637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:09:53.040637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:09:53.040637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:09:53.040637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:53.040637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 530/1102] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:09:53.045485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c597db6-89bc-4926-9cdb-2b24782571e2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:53.144314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c597db6-89bc-4926-9cdb-2b24782571e2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:53.173071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:53.178574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce968e29-5d0d-442e-8d24-3aaf8c689b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:53.179230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce968e29-5d0d-442e-8d24-3aaf8c689b84 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:53.179536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce968e29-5d0d-442e-8d24-3aaf8c689b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:53.179810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce968e29-5d0d-442e-8d24-3aaf8c689b84 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:53.180525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce968e29-5d0d-442e-8d24-3aaf8c689b84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:53.180830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce968e29-5d0d-442e-8d24-3aaf8c689b84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:53.182273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce968e29-5d0d-442e-8d24-3aaf8c689b84 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:53.193653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 573/1103] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:53.199418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62296bdb-f508-4b87-8dca-1ca950508174 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:53.296577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62296bdb-f508-4b87-8dca-1ca950508174 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:53.330198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec28d2-e4fd-4441-b8d1-27c23a901815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:53.331149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec28d2-e4fd-4441-b8d1-27c23a901815 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:53.331466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec28d2-e4fd-4441-b8d1-27c23a901815 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:53.331739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec28d2-e4fd-4441-b8d1-27c23a901815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:53.333612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:53.339635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec28d2-e4fd-4441-b8d1-27c23a901815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:53.341228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec28d2-e4fd-4441-b8d1-27c23a901815 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-79ec28d2-e4fd-4441-b8d1-27c23a901815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:09:53.354593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:09:53.355645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:09:53.356545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:09:53.356545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:09:53.356545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:09:53.356545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:09:53.356545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:09:53.356545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:09:53.356545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:09:53.356545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:09:53.356545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 531/1104] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:09:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:09:53.361541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce968e29-5d0d-442e-8d24-3aaf8c689b84 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:53.453831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506aa6-d510-401a-858b-9667901b70b6 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:53.454041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506aa6-d510-401a-858b-9667901b70b6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:53.454349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506aa6-d510-401a-858b-9667901b70b6 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:53.455831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 532/1105] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:09:53.459324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce968e29-5d0d-442e-8d24-3aaf8c689b84 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:53.460813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506f67f-5f32-49e2-a7ec-098e889141e9 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:53.461102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506f67f-5f32-49e2-a7ec-098e889141e9 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:53.461379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506f67f-5f32-49e2-a7ec-098e889141e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:53.477590 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6506f67f-5f32-49e2-a7ec-098e889141e9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:53.478775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6506f67f-5f32-49e2-a7ec-098e889141e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:53.494867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ea7f4-b2a7-485e-96c7-9c8fc5c66420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:53.495560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ea7f4-b2a7-485e-96c7-9c8fc5c66420 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:53.495845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ea7f4-b2a7-485e-96c7-9c8fc5c66420 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:53.496121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ea7f4-b2a7-485e-96c7-9c8fc5c66420 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:53.496948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ea7f4-b2a7-485e-96c7-9c8fc5c66420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:53.497252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ea7f4-b2a7-485e-96c7-9c8fc5c66420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:53.498668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ea7f4-b2a7-485e-96c7-9c8fc5c66420 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:53.511125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 574/1106] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:53.517118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ea7f4-b2a7-485e-96c7-9c8fc5c66420 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:53.547748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 533/1107] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:09:53.570028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:53.573187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506f67f-5f32-49e2-a7ec-098e889141e9 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:53.617464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ea7f4-b2a7-485e-96c7-9c8fc5c66420 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:53.650742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb1266-8d66-4223-a733-ff148c5b0c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:53.651427 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb1266-8d66-4223-a733-ff148c5b0c7d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:53.651713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb1266-8d66-4223-a733-ff148c5b0c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:53.651992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb1266-8d66-4223-a733-ff148c5b0c7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:53.652825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb1266-8d66-4223-a733-ff148c5b0c7d None admin] RBAC: Adding query filter params (role.id=a2fad9c023754ad5b921d75bf26d9efc, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=e1ea02cd5e644aaba236acf4e46cb20f) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:53.653136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb1266-8d66-4223-a733-ff148c5b0c7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:53.654558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb1266-8d66-4223-a733-ff148c5b0c7d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:53.660487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 575/1108] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:53 2022] GET /identity/v3/role_assignments?user.id=e1ea02cd5e644aaba236acf4e46cb20f&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=a2fad9c023754ad5b921d75bf26d9efc => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:53.671144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506f67f-5f32-49e2-a7ec-098e889141e9 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:53.699294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:53.710697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bff56-29d1-41b5-a243-30588c37492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:53.711453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bff56-29d1-41b5-a243-30588c37492e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:53.711737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bff56-29d1-41b5-a243-30588c37492e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:53.712012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bff56-29d1-41b5-a243-30588c37492e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:53.713229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bff56-29d1-41b5-a243-30588c37492e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:53.714698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bff56-29d1-41b5-a243-30588c37492e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:53.716416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 534/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:09:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:53.722510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb1266-8d66-4223-a733-ff148c5b0c7d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:53.826694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb1266-8d66-4223-a733-ff148c5b0c7d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:53.844451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:53.862825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ce981-0f9d-4244-8574-e683a02f6102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:53.863525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce981-0f9d-4244-8574-e683a02f6102 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:53.863812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce981-0f9d-4244-8574-e683a02f6102 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:53.864090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce981-0f9d-4244-8574-e683a02f6102 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:53.864814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce981-0f9d-4244-8574-e683a02f6102 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:53.866242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce981-0f9d-4244-8574-e683a02f6102 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:53.888170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 576/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:09:53 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:09:56.140235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217585a-1fbe-4e73-b621-3ce62637db40 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:56.140761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217585a-1fbe-4e73-b621-3ce62637db40 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:56.140855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217585a-1fbe-4e73-b621-3ce62637db40 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:56.142159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 535/1111] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:56.147524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341f9bf-eb29-4b08-8c59-b177954ac4eb None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:56.147922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341f9bf-eb29-4b08-8c59-b177954ac4eb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:56.148085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341f9bf-eb29-4b08-8c59-b177954ac4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:56.164920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b341f9bf-eb29-4b08-8c59-b177954ac4eb None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:56.166106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b341f9bf-eb29-4b08-8c59-b177954ac4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:56.231214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 577/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:56.255487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217585a-1fbe-4e73-b621-3ce62637db40 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:56.353615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217585a-1fbe-4e73-b621-3ce62637db40 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:56.387263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef764-83d5-4455-a781-d741dff407f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:56.388141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef764-83d5-4455-a781-d741dff407f0 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:56.388428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef764-83d5-4455-a781-d741dff407f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:56.388708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef764-83d5-4455-a781-d741dff407f0 None admin] PATH_INFO: `/v3/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:56.390186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef764-83d5-4455-a781-d741dff407f0 None admin] RBAC: Authorizing `identity:get_role(role_id=8b03cb8cbf3248d1a22cd48ec5c21eb6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:56.392154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef764-83d5-4455-a781-d741dff407f0 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:56.393457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 536/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:09:56 2022] GET /identity/v3/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:56.399050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341f9bf-eb29-4b08-8c59-b177954ac4eb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:56.496387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341f9bf-eb29-4b08-8c59-b177954ac4eb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:56.497877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:56.530955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32032-899c-4964-a0ec-ba513244b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:56.532409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32032-899c-4964-a0ec-ba513244b81f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:56.532686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32032-899c-4964-a0ec-ba513244b81f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:56.532962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32032-899c-4964-a0ec-ba513244b81f None admin] PATH_INFO: `/v3/users/8fc3197bdab94a869b079b767a2803ab` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:56.545509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32032-899c-4964-a0ec-ba513244b81f None admin] RBAC: Authorizing `identity:get_user(user_id=8fc3197bdab94a869b079b767a2803ab)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:56.546910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32032-899c-4964-a0ec-ba513244b81f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:56.548583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 578/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:09:56 2022] GET /identity/v3/users/8fc3197bdab94a869b079b767a2803ab => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:09:56.554247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef764-83d5-4455-a781-d741dff407f0 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:56.614146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:56.653543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef764-83d5-4455-a781-d741dff407f0 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:56.686070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa224398-a6ce-4c42-96d1-89c2c1641c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:56.686710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa224398-a6ce-4c42-96d1-89c2c1641c50 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:56.686997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa224398-a6ce-4c42-96d1-89c2c1641c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:56.687276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa224398-a6ce-4c42-96d1-89c2c1641c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:56.751763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa224398-a6ce-4c42-96d1-89c2c1641c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:56.753192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa224398-a6ce-4c42-96d1-89c2c1641c50 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:56.808154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:56.849184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 537/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:09:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:09:56.854945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32032-899c-4964-a0ec-ba513244b81f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:56.950460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32032-899c-4964-a0ec-ba513244b81f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:56.983484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb78a2e-0f06-4921-a342-665e81662524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:56.984330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb78a2e-0f06-4921-a342-665e81662524 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:56.984614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb78a2e-0f06-4921-a342-665e81662524 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:56.984919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb78a2e-0f06-4921-a342-665e81662524 None admin] PATH_INFO: `/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:56.986091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb78a2e-0f06-4921-a342-665e81662524 None admin] RBAC: Authorizing `identity:get_project(project_id=fd6a8369958b43cfabd4a2af0ed37c65)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:56.987533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb78a2e-0f06-4921-a342-665e81662524 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:56.989221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 579/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:09:56 2022] GET /identity/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:56.995157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa224398-a6ce-4c42-96d1-89c2c1641c50 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:57.091229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa224398-a6ce-4c42-96d1-89c2c1641c50 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:57.126605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4d921-9d9c-442c-9f6c-986ff01a3b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:57.127248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d921-9d9c-442c-9f6c-986ff01a3b38 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:57.127561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d921-9d9c-442c-9f6c-986ff01a3b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:57.127837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4d921-9d9c-442c-9f6c-986ff01a3b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:57.128665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4d921-9d9c-442c-9f6c-986ff01a3b38 None admin] RBAC: Adding query filter params (role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=fd6a8369958b43cfabd4a2af0ed37c65, user.id=8fc3197bdab94a869b079b767a2803ab) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:09:57.128972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4d921-9d9c-442c-9f6c-986ff01a3b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:57.130375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4d921-9d9c-442c-9f6c-986ff01a3b38 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:57.135731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 538/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:09:56 2022] GET /identity/v3/role_assignments?user.id=8fc3197bdab94a869b079b767a2803ab&scope.project.id=fd6a8369958b43cfabd4a2af0ed37c65&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:59.316150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c28f70-c1e6-442e-8439-a15f80b3753a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:59.316682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c28f70-c1e6-442e-8439-a15f80b3753a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:59.316682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c28f70-c1e6-442e-8439-a15f80b3753a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:59.318055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 580/1118] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:09:59.323553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb0052-7901-42b3-9a9a-11a6f6a63d05 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:59.323939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb0052-7901-42b3-9a9a-11a6f6a63d05 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:59.324099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb0052-7901-42b3-9a9a-11a6f6a63d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:59.340294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-f5fb0052-7901-42b3-9a9a-11a6f6a63d05 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:09:59.341458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f5fb0052-7901-42b3-9a9a-11a6f6a63d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:09:59.358569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:59.406202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 539/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:09:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:09:59.428726 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c28f70-c1e6-442e-8439-a15f80b3753a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:59.456699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:59.528152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c28f70-c1e6-442e-8439-a15f80b3753a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:59.560637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db59036-ef19-4676-ba97-7236e3f85362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:59.561476 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db59036-ef19-4676-ba97-7236e3f85362 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:59.561760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db59036-ef19-4676-ba97-7236e3f85362 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:59.562035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db59036-ef19-4676-ba97-7236e3f85362 None admin] PATH_INFO: `/v3/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:59.563550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db59036-ef19-4676-ba97-7236e3f85362 None admin] RBAC: Authorizing `identity:get_role(role_id=8b03cb8cbf3248d1a22cd48ec5c21eb6)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:59.564896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db59036-ef19-4676-ba97-7236e3f85362 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:59.566311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 581/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:09:59 2022] GET /identity/v3/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:59.572167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb0052-7901-42b3-9a9a-11a6f6a63d05 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:59.668791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb0052-7901-42b3-9a9a-11a6f6a63d05 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:59.701309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a86524-53e5-4866-8522-0e5807079fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:59.702183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a86524-53e5-4866-8522-0e5807079fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:59.702464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a86524-53e5-4866-8522-0e5807079fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:59.702740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a86524-53e5-4866-8522-0e5807079fb5 None admin] PATH_INFO: `/v3/users/8fc3197bdab94a869b079b767a2803ab` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:59.704465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a86524-53e5-4866-8522-0e5807079fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=8fc3197bdab94a869b079b767a2803ab)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:59.705896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a86524-53e5-4866-8522-0e5807079fb5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:59.707532 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 540/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:09:59 2022] GET /identity/v3/users/8fc3197bdab94a869b079b767a2803ab => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:59.713189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db59036-ef19-4676-ba97-7236e3f85362 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:59.803687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:59.809930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db59036-ef19-4676-ba97-7236e3f85362 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:59.843542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9836-6507-4a87-981c-9ede3f57420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:59.844332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9836-6507-4a87-981c-9ede3f57420e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:59.844617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9836-6507-4a87-981c-9ede3f57420e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:59.844900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9836-6507-4a87-981c-9ede3f57420e None admin] PATH_INFO: `/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:59.846076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9836-6507-4a87-981c-9ede3f57420e None admin] RBAC: Authorizing `identity:get_project(project_id=fd6a8369958b43cfabd4a2af0ed37c65)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:59.847530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9836-6507-4a87-981c-9ede3f57420e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:09:59.849208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 582/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:09:59 2022] GET /identity/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:09:59.854944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a86524-53e5-4866-8522-0e5807079fb5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:09:59.879054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:09:59.951989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a86524-53e5-4866-8522-0e5807079fb5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:09:59.984723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c019d-c46d-42f3-b54c-47e085ccc32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:09:59.985623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c019d-c46d-42f3-b54c-47e085ccc32b None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:09:59.985907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c019d-c46d-42f3-b54c-47e085ccc32b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:09:59.986184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c019d-c46d-42f3-b54c-47e085ccc32b None admin] PATH_INFO: `/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65/users/8fc3197bdab94a869b079b767a2803ab/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:09:59.988417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c019d-c46d-42f3-b54c-47e085ccc32b None admin] RBAC: Authorizing `identity:create_grant(project_id=fd6a8369958b43cfabd4a2af0ed37c65, user_id=8fc3197bdab94a869b079b767a2803ab, role_id=8b03cb8cbf3248d1a22cd48ec5c21eb6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:09:59.989834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c019d-c46d-42f3-b54c-47e085ccc32b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:00.002166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 541/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:09:59 2022] PUT /identity/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65/users/8fc3197bdab94a869b079b767a2803ab/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:10:02.176814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9670b1-6efb-44e6-9eed-b52dd62113d5 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:02.177335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9670b1-6efb-44e6-9eed-b52dd62113d5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:02.177456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9670b1-6efb-44e6-9eed-b52dd62113d5 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:02.178727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 583/1124] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:02.184046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9174e-029d-4de3-a0c6-bcfc38158c30 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:02.184441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9174e-029d-4de3-a0c6-bcfc38158c30 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:02.184607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9174e-029d-4de3-a0c6-bcfc38158c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:02.201193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e5c9174e-029d-4de3-a0c6-bcfc38158c30 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:02.202363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e5c9174e-029d-4de3-a0c6-bcfc38158c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:02.266121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 542/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:02.289650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9670b1-6efb-44e6-9eed-b52dd62113d5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:02.387732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9670b1-6efb-44e6-9eed-b52dd62113d5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:02.421798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5037688-7c12-491a-96fa-abf2ae68ed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:02.422663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5037688-7c12-491a-96fa-abf2ae68ed5c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:02.422952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5037688-7c12-491a-96fa-abf2ae68ed5c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:02.423231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5037688-7c12-491a-96fa-abf2ae68ed5c None admin] PATH_INFO: `/v3/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:02.424736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5037688-7c12-491a-96fa-abf2ae68ed5c None admin] RBAC: Authorizing `identity:get_role(role_id=8b03cb8cbf3248d1a22cd48ec5c21eb6)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:02.426081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5037688-7c12-491a-96fa-abf2ae68ed5c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:02.427491 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 584/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:10:02 2022] GET /identity/v3/roles/8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:02.433005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9174e-029d-4de3-a0c6-bcfc38158c30 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:02.446742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:02.533020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9174e-029d-4de3-a0c6-bcfc38158c30 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:02.565225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37c919-7eac-4963-8c73-2cdde077bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:02.566096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c919-7eac-4963-8c73-2cdde077bc58 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:02.566383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c919-7eac-4963-8c73-2cdde077bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:02.566681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37c919-7eac-4963-8c73-2cdde077bc58 None admin] PATH_INFO: `/v3/users/8fc3197bdab94a869b079b767a2803ab` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:02.567870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37c919-7eac-4963-8c73-2cdde077bc58 None admin] RBAC: Authorizing `identity:get_user(user_id=8fc3197bdab94a869b079b767a2803ab)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:02.569296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37c919-7eac-4963-8c73-2cdde077bc58 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:02.570929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 543/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:10:02 2022] GET /identity/v3/users/8fc3197bdab94a869b079b767a2803ab => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:02.576910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5037688-7c12-491a-96fa-abf2ae68ed5c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:02.607836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:02.674447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5037688-7c12-491a-96fa-abf2ae68ed5c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:02.706912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0a2f5-ef6a-4f2f-93b1-23e2801476e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:02.707512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0a2f5-ef6a-4f2f-93b1-23e2801476e3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:02.707794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0a2f5-ef6a-4f2f-93b1-23e2801476e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:02.708063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0a2f5-ef6a-4f2f-93b1-23e2801476e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:02.772181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0a2f5-ef6a-4f2f-93b1-23e2801476e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:02.773601 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0a2f5-ef6a-4f2f-93b1-23e2801476e3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:02.801955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:02.868052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 585/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:10:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:10:02.873872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37c919-7eac-4963-8c73-2cdde077bc58 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:02.952235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:02.971554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37c919-7eac-4963-8c73-2cdde077bc58 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:03.003732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ac6b6-fff4-4119-bee7-f614c16f018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:03.004576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ac6b6-fff4-4119-bee7-f614c16f018a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:03.004855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ac6b6-fff4-4119-bee7-f614c16f018a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:03.005125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ac6b6-fff4-4119-bee7-f614c16f018a None admin] PATH_INFO: `/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:03.006298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ac6b6-fff4-4119-bee7-f614c16f018a None admin] RBAC: Authorizing `identity:get_project(project_id=fd6a8369958b43cfabd4a2af0ed37c65)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:03.007727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ac6b6-fff4-4119-bee7-f614c16f018a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:03.009396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 544/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:10:02 2022] GET /identity/v3/projects/fd6a8369958b43cfabd4a2af0ed37c65 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:03.015283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0a2f5-ef6a-4f2f-93b1-23e2801476e3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:03.110075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0a2f5-ef6a-4f2f-93b1-23e2801476e3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:03.138018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:03.143663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9010c4-4ee1-4555-a43d-29c76821412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:03.144307 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9010c4-4ee1-4555-a43d-29c76821412a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:03.144589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9010c4-4ee1-4555-a43d-29c76821412a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:03.144863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9010c4-4ee1-4555-a43d-29c76821412a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:03.145685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9010c4-4ee1-4555-a43d-29c76821412a None admin] RBAC: Adding query filter params (role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6, scope.project.id=fd6a8369958b43cfabd4a2af0ed37c65, user.id=8fc3197bdab94a869b079b767a2803ab) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:03.145995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9010c4-4ee1-4555-a43d-29c76821412a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:03.147437 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9010c4-4ee1-4555-a43d-29c76821412a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:03.153122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 586/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:10:03 2022] GET /identity/v3/role_assignments?user.id=8fc3197bdab94a869b079b767a2803ab&scope.project.id=fd6a8369958b43cfabd4a2af0ed37c65&role.id=8b03cb8cbf3248d1a22cd48ec5c21eb6 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:05.371141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea0976-fe58-4f86-aad2-18db9ee7a9b5 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:05.371755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea0976-fe58-4f86-aad2-18db9ee7a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:05.371755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea0976-fe58-4f86-aad2-18db9ee7a9b5 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:05.373079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 545/1131] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:05.378229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e9c2c-8d6b-4b40-b98d-ecc08d197cb2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:05.378612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e9c2c-8d6b-4b40-b98d-ecc08d197cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:05.378795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e9c2c-8d6b-4b40-b98d-ecc08d197cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:05.395630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f11e9c2c-8d6b-4b40-b98d-ecc08d197cb2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:05.396806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f11e9c2c-8d6b-4b40-b98d-ecc08d197cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:05.460708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 587/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:05.484354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea0976-fe58-4f86-aad2-18db9ee7a9b5 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:05.583139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea0976-fe58-4f86-aad2-18db9ee7a9b5 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:05.615949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30378db5-67a5-4a63-95eb-dad16571cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:05.616729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30378db5-67a5-4a63-95eb-dad16571cfff None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:05.617011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30378db5-67a5-4a63-95eb-dad16571cfff None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:05.617286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30378db5-67a5-4a63-95eb-dad16571cfff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:05.618448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30378db5-67a5-4a63-95eb-dad16571cfff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:05.619913 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30378db5-67a5-4a63-95eb-dad16571cfff None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:05.622525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 546/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:05.627207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e9c2c-8d6b-4b40-b98d-ecc08d197cb2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:05.723058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e9c2c-8d6b-4b40-b98d-ecc08d197cb2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:05.747095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:05.755882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8adfe-1b46-40f4-87b6-d6e38d940e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:05.756526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8adfe-1b46-40f4-87b6-d6e38d940e81 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:05.756806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8adfe-1b46-40f4-87b6-d6e38d940e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:05.757078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8adfe-1b46-40f4-87b6-d6e38d940e81 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:05.757771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8adfe-1b46-40f4-87b6-d6e38d940e81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:05.759173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8adfe-1b46-40f4-87b6-d6e38d940e81 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:05.783944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 588/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:10:05 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:10:08.003925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad92e5-ae73-45a6-8576-5a42cd03e371 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:08.004447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad92e5-ae73-45a6-8576-5a42cd03e371 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:08.004536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad92e5-ae73-45a6-8576-5a42cd03e371 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:08.005849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 547/1135] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:08.011105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb95600-c48c-4c5d-8140-98b2c03d4893 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:08.011559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb95600-c48c-4c5d-8140-98b2c03d4893 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:08.011697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb95600-c48c-4c5d-8140-98b2c03d4893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:08.028163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0cb95600-c48c-4c5d-8140-98b2c03d4893 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:08.029345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0cb95600-c48c-4c5d-8140-98b2c03d4893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:08.095273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 589/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:08.120092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad92e5-ae73-45a6-8576-5a42cd03e371 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:08.137771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:08.219357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad92e5-ae73-45a6-8576-5a42cd03e371 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:08.252938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b70cb8-53f6-497e-b9b2-491bf4edd971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:08.253716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b70cb8-53f6-497e-b9b2-491bf4edd971 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:08.254048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b70cb8-53f6-497e-b9b2-491bf4edd971 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:08.254278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b70cb8-53f6-497e-b9b2-491bf4edd971 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:08.255524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b70cb8-53f6-497e-b9b2-491bf4edd971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:08.256953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b70cb8-53f6-497e-b9b2-491bf4edd971 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:08.258554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 548/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:10:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:08.264417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb95600-c48c-4c5d-8140-98b2c03d4893 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:08.358690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb95600-c48c-4c5d-8140-98b2c03d4893 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:08.368163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:08.392944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f36519-96c2-4483-9d00-6c94c46cb8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:08.393597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f36519-96c2-4483-9d00-6c94c46cb8d3 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:08.393880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f36519-96c2-4483-9d00-6c94c46cb8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:08.394158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f36519-96c2-4483-9d00-6c94c46cb8d3 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:08.394866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f36519-96c2-4483-9d00-6c94c46cb8d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:08.396460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f36519-96c2-4483-9d00-6c94c46cb8d3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:08.415487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 590/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:10:08 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:10:10.666108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19636190-614b-46f4-bcce-542e02ee8728 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:10.666621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19636190-614b-46f4-bcce-542e02ee8728 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:10.666712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19636190-614b-46f4-bcce-542e02ee8728 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:10.668081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 549/1139] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:10.673859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966656e-6fe6-49ef-ba06-4cc0d607f417 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:10.674240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966656e-6fe6-49ef-ba06-4cc0d607f417 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:10.674443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966656e-6fe6-49ef-ba06-4cc0d607f417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:10.691263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f966656e-6fe6-49ef-ba06-4cc0d607f417 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:10.692471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f966656e-6fe6-49ef-ba06-4cc0d607f417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:10.757195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 591/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:10.780583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19636190-614b-46f4-bcce-542e02ee8728 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:10.863789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:10.880774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19636190-614b-46f4-bcce-542e02ee8728 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:10.916549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f22a81-d374-48f7-a58c-a8cc039b407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:10.917332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22a81-d374-48f7-a58c-a8cc039b407e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:10.917619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22a81-d374-48f7-a58c-a8cc039b407e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:10.917897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f22a81-d374-48f7-a58c-a8cc039b407e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:10.928422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f22a81-d374-48f7-a58c-a8cc039b407e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-31f22a81-d374-48f7-a58c-a8cc039b407e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:10:10.936107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:10:10.937185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:10:10.938250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 550/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:10:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:10:10.944107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966656e-6fe6-49ef-ba06-4cc0d607f417 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:11.032708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:11.040047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966656e-6fe6-49ef-ba06-4cc0d607f417 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:11.072694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996912f2-7868-48b2-acee-d5aba2d6f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:11.073348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996912f2-7868-48b2-acee-d5aba2d6f272 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:11.073631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996912f2-7868-48b2-acee-d5aba2d6f272 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:11.073906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996912f2-7868-48b2-acee-d5aba2d6f272 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:11.074928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996912f2-7868-48b2-acee-d5aba2d6f272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:11.075231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996912f2-7868-48b2-acee-d5aba2d6f272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:11.076617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996912f2-7868-48b2-acee-d5aba2d6f272 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:11.084396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 592/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:10:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:11.090016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f22a81-d374-48f7-a58c-a8cc039b407e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:11.187656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f22a81-d374-48f7-a58c-a8cc039b407e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:11.220446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d8725-7114-4005-a60a-40ac4ab060e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:11.221305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d8725-7114-4005-a60a-40ac4ab060e5 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:11.221591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d8725-7114-4005-a60a-40ac4ab060e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:11.221868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d8725-7114-4005-a60a-40ac4ab060e5 None admin] PATH_INFO: `/v3/users/b863854620c644419a9b9bd5505cb332` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:11.234525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d8725-7114-4005-a60a-40ac4ab060e5 None admin] RBAC: Authorizing `identity:get_user(user_id=b863854620c644419a9b9bd5505cb332)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:11.236596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d8725-7114-4005-a60a-40ac4ab060e5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:11.238218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 551/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:10:11 2022] GET /identity/v3/users/b863854620c644419a9b9bd5505cb332 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:11.243929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996912f2-7868-48b2-acee-d5aba2d6f272 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:11.340211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996912f2-7868-48b2-acee-d5aba2d6f272 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:11.372978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a92f6f-fb33-4bf4-aeef-e00cb27ed11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:11.373613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a92f6f-fb33-4bf4-aeef-e00cb27ed11d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:11.373896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a92f6f-fb33-4bf4-aeef-e00cb27ed11d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:11.374171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a92f6f-fb33-4bf4-aeef-e00cb27ed11d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:11.397963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:11.438937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a92f6f-fb33-4bf4-aeef-e00cb27ed11d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:11.440405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a92f6f-fb33-4bf4-aeef-e00cb27ed11d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:11.537818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 593/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:10:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:10:11.543624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d8725-7114-4005-a60a-40ac4ab060e5 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:11.546440 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:11.641086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d8725-7114-4005-a60a-40ac4ab060e5 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:11.674517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707599c2-92d8-42ab-9296-9efe0e3618ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:11.675383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707599c2-92d8-42ab-9296-9efe0e3618ec None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:11.675669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707599c2-92d8-42ab-9296-9efe0e3618ec None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:11.675969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707599c2-92d8-42ab-9296-9efe0e3618ec None admin] PATH_INFO: `/v3/projects/824f7df8bd0f4937ade1a2a5436395c0` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:11.677130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707599c2-92d8-42ab-9296-9efe0e3618ec None admin] RBAC: Authorizing `identity:get_project(project_id=824f7df8bd0f4937ade1a2a5436395c0)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:11.678539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707599c2-92d8-42ab-9296-9efe0e3618ec None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:11.680246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 552/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:10:11 2022] GET /identity/v3/projects/824f7df8bd0f4937ade1a2a5436395c0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:11.686148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a92f6f-fb33-4bf4-aeef-e00cb27ed11d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:11.740293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:11.781722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a92f6f-fb33-4bf4-aeef-e00cb27ed11d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:11.814409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd584069-522d-4ec2-a65f-a6bdb4d75389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:11.815044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd584069-522d-4ec2-a65f-a6bdb4d75389 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:11.815322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd584069-522d-4ec2-a65f-a6bdb4d75389 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:11.815621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd584069-522d-4ec2-a65f-a6bdb4d75389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:11.816442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd584069-522d-4ec2-a65f-a6bdb4d75389 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=824f7df8bd0f4937ade1a2a5436395c0, user.id=b863854620c644419a9b9bd5505cb332) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:11.816750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd584069-522d-4ec2-a65f-a6bdb4d75389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:11.818154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd584069-522d-4ec2-a65f-a6bdb4d75389 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:11.823403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 594/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:10:11 2022] GET /identity/v3/role_assignments?user.id=b863854620c644419a9b9bd5505cb332&scope.project.id=824f7df8bd0f4937ade1a2a5436395c0&role.id=c6577847f998435991dac5744a94d0ee => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:14.022958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8b099-942a-4ee8-80ba-0aae18db4611 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:14.023552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8b099-942a-4ee8-80ba-0aae18db4611 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:14.023552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8b099-942a-4ee8-80ba-0aae18db4611 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:14.024886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 553/1147] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:14.030095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70898887-0b0b-4f22-be43-302e7c3866fa None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:14.030500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70898887-0b0b-4f22-be43-302e7c3866fa None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:14.030653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70898887-0b0b-4f22-be43-302e7c3866fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:14.047686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-70898887-0b0b-4f22-be43-302e7c3866fa None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:14.049488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-70898887-0b0b-4f22-be43-302e7c3866fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:14.113444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 595/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:14.135708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8b099-942a-4ee8-80ba-0aae18db4611 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:14.203729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:14.234797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8b099-942a-4ee8-80ba-0aae18db4611 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:14.268335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4976d-f362-4538-a119-8c53b0b24f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:14.269123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4976d-f362-4538-a119-8c53b0b24f33 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:14.269411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4976d-f362-4538-a119-8c53b0b24f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:14.269691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4976d-f362-4538-a119-8c53b0b24f33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:14.279689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4976d-f362-4538-a119-8c53b0b24f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-00e4976d-f362-4538-a119-8c53b0b24f33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:10:14.287802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:10:14.288927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:10:14.290017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 554/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:10:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:10:14.295045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70898887-0b0b-4f22-be43-302e7c3866fa None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:14.342760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:14.390666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70898887-0b0b-4f22-be43-302e7c3866fa None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:14.423701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bd879-94c4-483b-aacc-862491369a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:14.424352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bd879-94c4-483b-aacc-862491369a57 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:14.424635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bd879-94c4-483b-aacc-862491369a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:14.424916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bd879-94c4-483b-aacc-862491369a57 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:14.425646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bd879-94c4-483b-aacc-862491369a57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:14.425952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bd879-94c4-483b-aacc-862491369a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:14.427294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bd879-94c4-483b-aacc-862491369a57 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:14.435063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 596/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:10:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:14.440815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4976d-f362-4538-a119-8c53b0b24f33 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:14.541036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4976d-f362-4538-a119-8c53b0b24f33 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:14.567800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:14.573881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99f584-7a14-4b14-aa8d-0608eb36030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:14.575013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f584-7a14-4b14-aa8d-0608eb36030f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:14.575295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f584-7a14-4b14-aa8d-0608eb36030f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:14.575608 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99f584-7a14-4b14-aa8d-0608eb36030f None admin] PATH_INFO: `/v3/users/b863854620c644419a9b9bd5505cb332` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:14.576800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99f584-7a14-4b14-aa8d-0608eb36030f None admin] RBAC: Authorizing `identity:get_user(user_id=b863854620c644419a9b9bd5505cb332)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:14.578223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99f584-7a14-4b14-aa8d-0608eb36030f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:14.580366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 555/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:10:14 2022] GET /identity/v3/users/b863854620c644419a9b9bd5505cb332 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:14.586060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bd879-94c4-483b-aacc-862491369a57 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:14.682118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bd879-94c4-483b-aacc-862491369a57 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:14.694245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:14.715052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11245954-da81-4a77-ae37-c5154970f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:14.715936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11245954-da81-4a77-ae37-c5154970f250 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:14.716222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11245954-da81-4a77-ae37-c5154970f250 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:14.716496 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11245954-da81-4a77-ae37-c5154970f250 None admin] PATH_INFO: `/v3/projects/824f7df8bd0f4937ade1a2a5436395c0` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:14.717673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11245954-da81-4a77-ae37-c5154970f250 None admin] RBAC: Authorizing `identity:get_project(project_id=824f7df8bd0f4937ade1a2a5436395c0)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:14.719085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11245954-da81-4a77-ae37-c5154970f250 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:14.721371 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 597/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:10:14 2022] GET /identity/v3/projects/824f7df8bd0f4937ade1a2a5436395c0 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:14.727053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99f584-7a14-4b14-aa8d-0608eb36030f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:14.823752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99f584-7a14-4b14-aa8d-0608eb36030f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:14.856316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105ef6e-ca2c-4254-a1da-eb52d92e7fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:14.857183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105ef6e-ca2c-4254-a1da-eb52d92e7fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:14.857465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105ef6e-ca2c-4254-a1da-eb52d92e7fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:14.857740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105ef6e-ca2c-4254-a1da-eb52d92e7fc1 None admin] PATH_INFO: `/v3/projects/824f7df8bd0f4937ade1a2a5436395c0/users/b863854620c644419a9b9bd5505cb332/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:14.859704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105ef6e-ca2c-4254-a1da-eb52d92e7fc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=824f7df8bd0f4937ade1a2a5436395c0, user_id=b863854620c644419a9b9bd5505cb332, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:14.861112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105ef6e-ca2c-4254-a1da-eb52d92e7fc1 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:14.873926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 556/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:10:14 2022] PUT /identity/v3/projects/824f7df8bd0f4937ade1a2a5436395c0/users/b863854620c644419a9b9bd5505cb332/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:10:17.077215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68ae9b-1ef9-432f-a5ac-f9a0cdd5a08c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:17.077842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68ae9b-1ef9-432f-a5ac-f9a0cdd5a08c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:17.077842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68ae9b-1ef9-432f-a5ac-f9a0cdd5a08c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:17.079109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 598/1154] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:17.084514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ca94a-c506-4bb9-9c93-42e6a7162f2f None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:17.084937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ca94a-c506-4bb9-9c93-42e6a7162f2f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:17.085073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ca94a-c506-4bb9-9c93-42e6a7162f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:17.101904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-ee3ca94a-c506-4bb9-9c93-42e6a7162f2f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:17.103096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ee3ca94a-c506-4bb9-9c93-42e6a7162f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:17.154171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:17.168915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 557/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:17.192592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68ae9b-1ef9-432f-a5ac-f9a0cdd5a08c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:17.291682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68ae9b-1ef9-432f-a5ac-f9a0cdd5a08c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:17.323892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a082e-05c3-428e-bda9-4f0fbeeece05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:17.324925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a082e-05c3-428e-bda9-4f0fbeeece05 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:17.325206 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a082e-05c3-428e-bda9-4f0fbeeece05 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:17.325480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a082e-05c3-428e-bda9-4f0fbeeece05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:17.335723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a082e-05c3-428e-bda9-4f0fbeeece05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-df1a082e-05c3-428e-bda9-4f0fbeeece05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:10:17.343175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:10:17.344379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:10:17.346023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 599/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:10:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:10:17.350967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ca94a-c506-4bb9-9c93-42e6a7162f2f None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:17.447285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ca94a-c506-4bb9-9c93-42e6a7162f2f None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:17.480908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e954-1dbb-49d4-8387-0e6275c49455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:17.481578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e954-1dbb-49d4-8387-0e6275c49455 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:17.481864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e954-1dbb-49d4-8387-0e6275c49455 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:17.482144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e954-1dbb-49d4-8387-0e6275c49455 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:17.482895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e954-1dbb-49d4-8387-0e6275c49455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:17.483204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e954-1dbb-49d4-8387-0e6275c49455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:17.484594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e954-1dbb-49d4-8387-0e6275c49455 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:17.492883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 558/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:10:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:17.498590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a082e-05c3-428e-bda9-4f0fbeeece05 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:17.541259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:17.597214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a082e-05c3-428e-bda9-4f0fbeeece05 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:17.629747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab25dd-4b24-4288-a5e5-135473a6db4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:17.630593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab25dd-4b24-4288-a5e5-135473a6db4a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:17.630872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab25dd-4b24-4288-a5e5-135473a6db4a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:17.631146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab25dd-4b24-4288-a5e5-135473a6db4a None admin] PATH_INFO: `/v3/users/b863854620c644419a9b9bd5505cb332` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:17.632346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab25dd-4b24-4288-a5e5-135473a6db4a None admin] RBAC: Authorizing `identity:get_user(user_id=b863854620c644419a9b9bd5505cb332)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:17.633755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab25dd-4b24-4288-a5e5-135473a6db4a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:17.635346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 600/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:10:17 2022] GET /identity/v3/users/b863854620c644419a9b9bd5505cb332 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:17.641022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e954-1dbb-49d4-8387-0e6275c49455 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:17.689506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:17.738620 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e954-1dbb-49d4-8387-0e6275c49455 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:17.770505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806292-666c-490a-8e9f-d6fd9e32c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:17.771135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806292-666c-490a-8e9f-d6fd9e32c723 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:17.771445 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806292-666c-490a-8e9f-d6fd9e32c723 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:17.771722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806292-666c-490a-8e9f-d6fd9e32c723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:17.836200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9806292-666c-490a-8e9f-d6fd9e32c723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:17.837615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9806292-666c-490a-8e9f-d6fd9e32c723 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:17.882812 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:17.931416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 559/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:10:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:10:17.937307 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab25dd-4b24-4288-a5e5-135473a6db4a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:18.033282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab25dd-4b24-4288-a5e5-135473a6db4a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:18.042053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:18.066166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ec8f-f68b-4cc9-bdaf-c62d81baf3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:18.067002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ec8f-f68b-4cc9-bdaf-c62d81baf3ae None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:18.067282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ec8f-f68b-4cc9-bdaf-c62d81baf3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:18.067583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ec8f-f68b-4cc9-bdaf-c62d81baf3ae None admin] PATH_INFO: `/v3/projects/824f7df8bd0f4937ade1a2a5436395c0` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:18.068751 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85ec8f-f68b-4cc9-bdaf-c62d81baf3ae None admin] RBAC: Authorizing `identity:get_project(project_id=824f7df8bd0f4937ade1a2a5436395c0)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:18.070159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85ec8f-f68b-4cc9-bdaf-c62d81baf3ae None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:18.071859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 601/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:10:17 2022] GET /identity/v3/projects/824f7df8bd0f4937ade1a2a5436395c0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:18.078032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806292-666c-490a-8e9f-d6fd9e32c723 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:18.172760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806292-666c-490a-8e9f-d6fd9e32c723 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:18.205736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d077c4-e922-497a-b99c-f4e672914dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:18.206378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d077c4-e922-497a-b99c-f4e672914dae None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:18.206656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d077c4-e922-497a-b99c-f4e672914dae None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:18.206927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d077c4-e922-497a-b99c-f4e672914dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:18.207778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d077c4-e922-497a-b99c-f4e672914dae None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=824f7df8bd0f4937ade1a2a5436395c0, user.id=b863854620c644419a9b9bd5505cb332) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:18.208084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d077c4-e922-497a-b99c-f4e672914dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:18.209489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d077c4-e922-497a-b99c-f4e672914dae None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:18.215087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 560/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:10:18 2022] GET /identity/v3/role_assignments?user.id=b863854620c644419a9b9bd5505cb332&scope.project.id=824f7df8bd0f4937ade1a2a5436395c0&role.id=c6577847f998435991dac5744a94d0ee => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:20.433440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb06a54-b0e9-4482-9bd1-7410da75980a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:20.434004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb06a54-b0e9-4482-9bd1-7410da75980a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:20.434004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb06a54-b0e9-4482-9bd1-7410da75980a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:20.435362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 602/1162] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:20.440739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98264c1-cc8c-4703-9096-26ed9ce707cc None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:20.441147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98264c1-cc8c-4703-9096-26ed9ce707cc None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:20.441310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98264c1-cc8c-4703-9096-26ed9ce707cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:20.458610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a98264c1-cc8c-4703-9096-26ed9ce707cc None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:20.459836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a98264c1-cc8c-4703-9096-26ed9ce707cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:20.468834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:20.525568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 561/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:20.548423 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb06a54-b0e9-4482-9bd1-7410da75980a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:20.647467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb06a54-b0e9-4482-9bd1-7410da75980a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:20.680198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fc9a2-5c73-44b0-b1b3-1c06b07fd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:20.680823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fc9a2-5c73-44b0-b1b3-1c06b07fd516 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:20.681104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fc9a2-5c73-44b0-b1b3-1c06b07fd516 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:20.681379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fc9a2-5c73-44b0-b1b3-1c06b07fd516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:20.724959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:20.746667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fc9a2-5c73-44b0-b1b3-1c06b07fd516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:20.748113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fc9a2-5c73-44b0-b1b3-1c06b07fd516 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:20.842387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 603/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:10:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:10:20.848323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98264c1-cc8c-4703-9096-26ed9ce707cc None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:20.941808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98264c1-cc8c-4703-9096-26ed9ce707cc None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:20.974424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dfced-a1e8-4359-b112-b62fbaf2d17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:20.975255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dfced-a1e8-4359-b112-b62fbaf2d17e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:20.975585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dfced-a1e8-4359-b112-b62fbaf2d17e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:20.975863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dfced-a1e8-4359-b112-b62fbaf2d17e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:20.982273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dfced-a1e8-4359-b112-b62fbaf2d17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:20.983729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dfced-a1e8-4359-b112-b62fbaf2d17e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-d73dfced-a1e8-4359-b112-b62fbaf2d17e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:10:20.997443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:10:20.998706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:10:20.999628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 562/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:10:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:10:21.005051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fc9a2-5c73-44b0-b1b3-1c06b07fd516 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:21.078667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:21.101235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fc9a2-5c73-44b0-b1b3-1c06b07fd516 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:21.133855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b5c94-3823-4ec0-b237-b9fcd68274ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:21.134508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b5c94-3823-4ec0-b237-b9fcd68274ca None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:21.134794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b5c94-3823-4ec0-b237-b9fcd68274ca None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:21.135074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b5c94-3823-4ec0-b237-b9fcd68274ca None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:21.135895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b5c94-3823-4ec0-b237-b9fcd68274ca None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:21.136206 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b5c94-3823-4ec0-b237-b9fcd68274ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:21.137569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b5c94-3823-4ec0-b237-b9fcd68274ca None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:21.145042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 604/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jun 7 14:10:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:23.364224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0055f-110c-4914-8b96-638c979b4fd5 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:23.364774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0055f-110c-4914-8b96-638c979b4fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:23.364774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0055f-110c-4914-8b96-638c979b4fd5 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:23.366160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 563/1167] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:23.371486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcafed-dba4-429a-9f05-36865493a401 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:23.371877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcafed-dba4-429a-9f05-36865493a401 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:23.372060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcafed-dba4-429a-9f05-36865493a401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:23.388475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e8dcafed-dba4-429a-9f05-36865493a401 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:23.389672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e8dcafed-dba4-429a-9f05-36865493a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:23.454078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 605/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:23.477618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0055f-110c-4914-8b96-638c979b4fd5 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:23.482174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:23.577358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0055f-110c-4914-8b96-638c979b4fd5 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:23.609929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05438420-a4ad-4873-92c7-f2f276312278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:23.610579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438420-a4ad-4873-92c7-f2f276312278 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:23.610859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438420-a4ad-4873-92c7-f2f276312278 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:23.611135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05438420-a4ad-4873-92c7-f2f276312278 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:23.611901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05438420-a4ad-4873-92c7-f2f276312278 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:23.613247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05438420-a4ad-4873-92c7-f2f276312278 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:23.627099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 564/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Tue Jun 7 14:10:23 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:10:25.857973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007b59b-e9a7-4cf0-b7ab-2a1a2258365d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:25.858474 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007b59b-e9a7-4cf0-b7ab-2a1a2258365d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:25.858474 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c007b59b-e9a7-4cf0-b7ab-2a1a2258365d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:25.859874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 606/1170] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:25.865524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b35ef-1029-41f1-9a5e-bf75dd89519d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:25.865941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b35ef-1029-41f1-9a5e-bf75dd89519d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:25.866076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b35ef-1029-41f1-9a5e-bf75dd89519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:25.882930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-5d3b35ef-1029-41f1-9a5e-bf75dd89519d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:25.884121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5d3b35ef-1029-41f1-9a5e-bf75dd89519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:25.939722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:25.948525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 565/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:25.971863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007b59b-e9a7-4cf0-b7ab-2a1a2258365d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:26.040708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:26.072095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c007b59b-e9a7-4cf0-b7ab-2a1a2258365d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:26.104826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c61a74-562b-4922-a501-0c63ade522dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:26.105675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c61a74-562b-4922-a501-0c63ade522dc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:26.105961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c61a74-562b-4922-a501-0c63ade522dc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:26.106239 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c61a74-562b-4922-a501-0c63ade522dc None admin] PATH_INFO: `/v3/domains/50a191425657424099920c9051944c9b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:26.117011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c61a74-562b-4922-a501-0c63ade522dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=50a191425657424099920c9051944c9b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:26.118391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c61a74-562b-4922-a501-0c63ade522dc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:26.120034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 607/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Tue Jun 7 14:10:25 2022] GET /identity/v3/domains/50a191425657424099920c9051944c9b => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:26.125727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b35ef-1029-41f1-9a5e-bf75dd89519d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:26.219486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b35ef-1029-41f1-9a5e-bf75dd89519d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:26.252237 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e754b6c-b46f-40e7-84cb-054a71385b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:26.252885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754b6c-b46f-40e7-84cb-054a71385b01 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:26.253166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754b6c-b46f-40e7-84cb-054a71385b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:26.253437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754b6c-b46f-40e7-84cb-054a71385b01 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:26.254137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e754b6c-b46f-40e7-84cb-054a71385b01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:26.255569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e754b6c-b46f-40e7-84cb-054a71385b01 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:26.280058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 566/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:10:26 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:10:28.551937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e213a-c53a-4ed4-bbd7-7c41e714d599 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:28.552387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e213a-c53a-4ed4-bbd7-7c41e714d599 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:28.552506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e213a-c53a-4ed4-bbd7-7c41e714d599 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:28.553843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 608/1174] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:28.559161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335a11e-1f5b-4106-ab6d-65885c040cc2 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:28.559713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335a11e-1f5b-4106-ab6d-65885c040cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:28.559814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335a11e-1f5b-4106-ab6d-65885c040cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:28.577475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-2335a11e-1f5b-4106-ab6d-65885c040cc2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:28.578674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2335a11e-1f5b-4106-ab6d-65885c040cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:28.619489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:28.646205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 567/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:28.670396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e213a-c53a-4ed4-bbd7-7c41e714d599 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:28.767846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e213a-c53a-4ed4-bbd7-7c41e714d599 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:28.793878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:28.800380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050e8a3-3657-4045-b4e0-77c025b30b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:28.801223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050e8a3-3657-4045-b4e0-77c025b30b7a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:28.801499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050e8a3-3657-4045-b4e0-77c025b30b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:28.801768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050e8a3-3657-4045-b4e0-77c025b30b7a None admin] PATH_INFO: `/v3/domains/50a191425657424099920c9051944c9b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:28.802933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050e8a3-3657-4045-b4e0-77c025b30b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=50a191425657424099920c9051944c9b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:28.804361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050e8a3-3657-4045-b4e0-77c025b30b7a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:28.805933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 609/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Tue Jun 7 14:10:28 2022] GET /identity/v3/domains/50a191425657424099920c9051944c9b => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:28.811562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335a11e-1f5b-4106-ab6d-65885c040cc2 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:28.906453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335a11e-1f5b-4106-ab6d-65885c040cc2 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:28.939686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a5922-2641-4498-8621-ee48fcbbc044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:28.940345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a5922-2641-4498-8621-ee48fcbbc044 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:28.940630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a5922-2641-4498-8621-ee48fcbbc044 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:28.940907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a5922-2641-4498-8621-ee48fcbbc044 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:28.941604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a5922-2641-4498-8621-ee48fcbbc044 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:28.943027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a5922-2641-4498-8621-ee48fcbbc044 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:28.962067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 568/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:10:28 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:10:31.213301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc961-1bfc-4efa-ad1f-96c965a3f822 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:31.213859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc961-1bfc-4efa-ad1f-96c965a3f822 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:31.213859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dc961-1bfc-4efa-ad1f-96c965a3f822 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:31.215232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 610/1178] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:31.220444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8daec-15b1-4ee6-8ac6-d5e9c645d8d4 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:31.220825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8daec-15b1-4ee6-8ac6-d5e9c645d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:31.221009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8daec-15b1-4ee6-8ac6-d5e9c645d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:31.237908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-91f8daec-15b1-4ee6-8ac6-d5e9c645d8d4 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:31.239091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-91f8daec-15b1-4ee6-8ac6-d5e9c645d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:31.264560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:31.305486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 569/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:31.328739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dc961-1bfc-4efa-ad1f-96c965a3f822 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:31.425876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dc961-1bfc-4efa-ad1f-96c965a3f822 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:31.457447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935aba2-8036-44f1-8c68-5e8f054ecdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:31.458224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935aba2-8036-44f1-8c68-5e8f054ecdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:31.458504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935aba2-8036-44f1-8c68-5e8f054ecdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:31.458774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935aba2-8036-44f1-8c68-5e8f054ecdb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:31.468947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935aba2-8036-44f1-8c68-5e8f054ecdb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6935aba2-8036-44f1-8c68-5e8f054ecdb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:10:31.477114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:10:31.478049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:10:31.478938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 611/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:10:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:10:31.484343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8daec-15b1-4ee6-8ac6-d5e9c645d8d4 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:31.580152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8daec-15b1-4ee6-8ac6-d5e9c645d8d4 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:31.613116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fda2a9-6936-451e-b640-b8e1abdea6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:31.613774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fda2a9-6936-451e-b640-b8e1abdea6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:31.614058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fda2a9-6936-451e-b640-b8e1abdea6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:31.614335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fda2a9-6936-451e-b640-b8e1abdea6c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:31.615076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fda2a9-6936-451e-b640-b8e1abdea6c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:31.615411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fda2a9-6936-451e-b640-b8e1abdea6c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:31.616799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fda2a9-6936-451e-b640-b8e1abdea6c9 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:31.624593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 570/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:31.630322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935aba2-8036-44f1-8c68-5e8f054ecdb7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:31.687034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:31.727234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935aba2-8036-44f1-8c68-5e8f054ecdb7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:31.758828 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc08d4-bde5-4264-8ab4-f16445f17422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:31.759709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc08d4-bde5-4264-8ab4-f16445f17422 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:31.759988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc08d4-bde5-4264-8ab4-f16445f17422 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:31.760259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc08d4-bde5-4264-8ab4-f16445f17422 None admin] PATH_INFO: `/v3/users/178c285835c64357a999ec1970e46679` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:31.773127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc08d4-bde5-4264-8ab4-f16445f17422 None admin] RBAC: Authorizing `identity:get_user(user_id=178c285835c64357a999ec1970e46679)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:31.774544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc08d4-bde5-4264-8ab4-f16445f17422 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:31.776182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 612/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:10:31 2022] GET /identity/v3/users/178c285835c64357a999ec1970e46679 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:31.781791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fda2a9-6936-451e-b640-b8e1abdea6c9 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:31.808289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:31.879834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fda2a9-6936-451e-b640-b8e1abdea6c9 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:31.912404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7dd93-ba77-4e3f-bf0f-f509cd31eea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:31.913035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7dd93-ba77-4e3f-bf0f-f509cd31eea7 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:31.913313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7dd93-ba77-4e3f-bf0f-f509cd31eea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:31.913584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7dd93-ba77-4e3f-bf0f-f509cd31eea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:31.977595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7dd93-ba77-4e3f-bf0f-f509cd31eea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:31.978952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7dd93-ba77-4e3f-bf0f-f509cd31eea7 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:32.001195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:32.073479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 571/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:10:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:10:32.079533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc08d4-bde5-4264-8ab4-f16445f17422 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:32.174162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc08d4-bde5-4264-8ab4-f16445f17422 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:32.190288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:32.208375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd1ea5-9413-4b93-9087-197ac12c6918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:32.209219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd1ea5-9413-4b93-9087-197ac12c6918 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:32.209498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd1ea5-9413-4b93-9087-197ac12c6918 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:32.209793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd1ea5-9413-4b93-9087-197ac12c6918 None admin] PATH_INFO: `/v3/projects/572efe1d1fca4ee6a6e37e847a934703` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:32.210949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd1ea5-9413-4b93-9087-197ac12c6918 None admin] RBAC: Authorizing `identity:get_project(project_id=572efe1d1fca4ee6a6e37e847a934703)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:32.212376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd1ea5-9413-4b93-9087-197ac12c6918 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:32.214032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 613/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:10:32 2022] GET /identity/v3/projects/572efe1d1fca4ee6a6e37e847a934703 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:32.220044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7dd93-ba77-4e3f-bf0f-f509cd31eea7 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:32.315893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7dd93-ba77-4e3f-bf0f-f509cd31eea7 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:32.339059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:32.350030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f5f32-fb4f-4a90-9f43-f48fb52bcf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:32.350682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f5f32-fb4f-4a90-9f43-f48fb52bcf5d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:32.350966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f5f32-fb4f-4a90-9f43-f48fb52bcf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:32.351245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f5f32-fb4f-4a90-9f43-f48fb52bcf5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:32.352106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f5f32-fb4f-4a90-9f43-f48fb52bcf5d None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=572efe1d1fca4ee6a6e37e847a934703, user.id=178c285835c64357a999ec1970e46679) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:32.352419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f5f32-fb4f-4a90-9f43-f48fb52bcf5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:32.353847 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f5f32-fb4f-4a90-9f43-f48fb52bcf5d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:32.359185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 572/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:10:32 2022] GET /identity/v3/role_assignments?user.id=178c285835c64357a999ec1970e46679&scope.project.id=572efe1d1fca4ee6a6e37e847a934703&role.id=c6577847f998435991dac5744a94d0ee => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:34.537677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f977447-80d0-4555-aff0-18810000756d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:34.538111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f977447-80d0-4555-aff0-18810000756d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:34.538221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f977447-80d0-4555-aff0-18810000756d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:34.539613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 614/1186] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:34.544682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12dbef-bd4a-49b1-99d0-4b801d96e1e8 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:34.545048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12dbef-bd4a-49b1-99d0-4b801d96e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:34.545244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12dbef-bd4a-49b1-99d0-4b801d96e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:34.562115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4b12dbef-bd4a-49b1-99d0-4b801d96e1e8 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:34.563285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4b12dbef-bd4a-49b1-99d0-4b801d96e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:34.628365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 573/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:34.651052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f977447-80d0-4555-aff0-18810000756d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:34.749225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f977447-80d0-4555-aff0-18810000756d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:34.781243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4050-7ea4-4478-9a4f-1c567ea07594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:34.782016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4050-7ea4-4478-9a4f-1c567ea07594 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:34.782291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4050-7ea4-4478-9a4f-1c567ea07594 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:34.782559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a4050-7ea4-4478-9a4f-1c567ea07594 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:34.792740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a4050-7ea4-4478-9a4f-1c567ea07594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ac5a4050-7ea4-4478-9a4f-1c567ea07594 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:10:34.800297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:10:34.801424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:10:34.802514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 615/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:10:34.807305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12dbef-bd4a-49b1-99d0-4b801d96e1e8 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:34.902610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12dbef-bd4a-49b1-99d0-4b801d96e1e8 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:34.919789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:34.936307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e84e20-d72b-4606-be0b-ea9421c520a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:34.936967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e84e20-d72b-4606-be0b-ea9421c520a3 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:34.937253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e84e20-d72b-4606-be0b-ea9421c520a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:34.937530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e84e20-d72b-4606-be0b-ea9421c520a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:34.938278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e84e20-d72b-4606-be0b-ea9421c520a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:34.938588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e84e20-d72b-4606-be0b-ea9421c520a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:34.940006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e84e20-d72b-4606-be0b-ea9421c520a3 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:34.947836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 574/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:34.953763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4050-7ea4-4478-9a4f-1c567ea07594 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:34.998138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:35.049914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a4050-7ea4-4478-9a4f-1c567ea07594 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:35.082812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab14382-7663-47eb-a5d9-a0baaac853a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:35.083694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab14382-7663-47eb-a5d9-a0baaac853a7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:35.083973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab14382-7663-47eb-a5d9-a0baaac853a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:35.084245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab14382-7663-47eb-a5d9-a0baaac853a7 None admin] PATH_INFO: `/v3/users/178c285835c64357a999ec1970e46679` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:35.085404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab14382-7663-47eb-a5d9-a0baaac853a7 None admin] RBAC: Authorizing `identity:get_user(user_id=178c285835c64357a999ec1970e46679)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:35.086810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab14382-7663-47eb-a5d9-a0baaac853a7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:35.088422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 616/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:10:34 2022] GET /identity/v3/users/178c285835c64357a999ec1970e46679 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:35.094130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e84e20-d72b-4606-be0b-ea9421c520a3 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:35.189658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e84e20-d72b-4606-be0b-ea9421c520a3 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:35.222117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43beda2f-32f9-4351-abc1-e62a87d5d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:35.222957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beda2f-32f9-4351-abc1-e62a87d5d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:35.223234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beda2f-32f9-4351-abc1-e62a87d5d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:35.223532 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43beda2f-32f9-4351-abc1-e62a87d5d0d8 None admin] PATH_INFO: `/v3/projects/572efe1d1fca4ee6a6e37e847a934703` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:35.224698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beda2f-32f9-4351-abc1-e62a87d5d0d8 None admin] RBAC: Authorizing `identity:get_project(project_id=572efe1d1fca4ee6a6e37e847a934703)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:35.226100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43beda2f-32f9-4351-abc1-e62a87d5d0d8 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:35.227800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 575/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:10:35 2022] GET /identity/v3/projects/572efe1d1fca4ee6a6e37e847a934703 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:35.233444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab14382-7663-47eb-a5d9-a0baaac853a7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:35.329047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab14382-7663-47eb-a5d9-a0baaac853a7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:35.341685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:35.362119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a245327-9daf-4fac-9473-8564eeb865fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:35.362991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a245327-9daf-4fac-9473-8564eeb865fc None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:35.363268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a245327-9daf-4fac-9473-8564eeb865fc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:35.363571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a245327-9daf-4fac-9473-8564eeb865fc None admin] PATH_INFO: `/v3/projects/572efe1d1fca4ee6a6e37e847a934703/users/178c285835c64357a999ec1970e46679/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:35.365510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a245327-9daf-4fac-9473-8564eeb865fc None admin] RBAC: Authorizing `identity:create_grant(project_id=572efe1d1fca4ee6a6e37e847a934703, user_id=178c285835c64357a999ec1970e46679, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:35.366918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a245327-9daf-4fac-9473-8564eeb865fc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:35.379576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 617/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:10:35 2022] PUT /identity/v3/projects/572efe1d1fca4ee6a6e37e847a934703/users/178c285835c64357a999ec1970e46679/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:10:37.565293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f241bb1-7544-4f0b-b7f5-69a5c9eff35a None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:37.565781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f241bb1-7544-4f0b-b7f5-69a5c9eff35a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:37.565885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f241bb1-7544-4f0b-b7f5-69a5c9eff35a None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:37.567209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 576/1193] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:10:37.572500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c4eeb-9ca7-40cd-8c22-e51684593b27 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:37.572876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c4eeb-9ca7-40cd-8c22-e51684593b27 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:37.573062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c4eeb-9ca7-40cd-8c22-e51684593b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:37.589730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-df4c4eeb-9ca7-40cd-8c22-e51684593b27 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:10:37.590942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-df4c4eeb-9ca7-40cd-8c22-e51684593b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:10:37.654923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 618/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:10:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:10:37.679074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f241bb1-7544-4f0b-b7f5-69a5c9eff35a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:37.729037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:37.779312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f241bb1-7544-4f0b-b7f5-69a5c9eff35a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:37.811374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db93c-700a-4ac9-a8e0-5fe7feb4d1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:37.812158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db93c-700a-4ac9-a8e0-5fe7feb4d1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:37.812442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db93c-700a-4ac9-a8e0-5fe7feb4d1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:37.812716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db93c-700a-4ac9-a8e0-5fe7feb4d1c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:37.823409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7db93c-700a-4ac9-a8e0-5fe7feb4d1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-4b7db93c-700a-4ac9-a8e0-5fe7feb4d1c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:10:37.831217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:10:37.832365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:10:37.833417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 577/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:10:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:10:37.838287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c4eeb-9ca7-40cd-8c22-e51684593b27 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:37.934254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c4eeb-9ca7-40cd-8c22-e51684593b27 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:37.935735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:37.969461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e65447-bce4-4d62-a88c-e3e5829eaf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:37.970118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e65447-bce4-4d62-a88c-e3e5829eaf1c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:37.970427 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e65447-bce4-4d62-a88c-e3e5829eaf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:37.970707 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e65447-bce4-4d62-a88c-e3e5829eaf1c None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:37.971485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e65447-bce4-4d62-a88c-e3e5829eaf1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:37.971796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e65447-bce4-4d62-a88c-e3e5829eaf1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:37.973145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e65447-bce4-4d62-a88c-e3e5829eaf1c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:37.980935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 619/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:10:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:37.986916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db93c-700a-4ac9-a8e0-5fe7feb4d1c6 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:38.084513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db93c-700a-4ac9-a8e0-5fe7feb4d1c6 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:38.093363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:38.118963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72922059-d3fd-4669-bbcb-48d3c8529f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:38.119852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72922059-d3fd-4669-bbcb-48d3c8529f85 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:38.120138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72922059-d3fd-4669-bbcb-48d3c8529f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:38.120415 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72922059-d3fd-4669-bbcb-48d3c8529f85 None admin] PATH_INFO: `/v3/users/178c285835c64357a999ec1970e46679` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:38.121598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72922059-d3fd-4669-bbcb-48d3c8529f85 None admin] RBAC: Authorizing `identity:get_user(user_id=178c285835c64357a999ec1970e46679)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:38.123008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72922059-d3fd-4669-bbcb-48d3c8529f85 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:38.124650 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 578/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jun 7 14:10:37 2022] GET /identity/v3/users/178c285835c64357a999ec1970e46679 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:38.130323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e65447-bce4-4d62-a88c-e3e5829eaf1c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:38.225218 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e65447-bce4-4d62-a88c-e3e5829eaf1c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:38.257472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166f99-4aaa-4b0d-867e-c1d774c37934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:38.258101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166f99-4aaa-4b0d-867e-c1d774c37934 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:38.258380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166f99-4aaa-4b0d-867e-c1d774c37934 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:38.258652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be166f99-4aaa-4b0d-867e-c1d774c37934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:38.289193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:38.325072 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166f99-4aaa-4b0d-867e-c1d774c37934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:38.326775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be166f99-4aaa-4b0d-867e-c1d774c37934 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:38.420825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 620/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:10:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:10:38.426823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72922059-d3fd-4669-bbcb-48d3c8529f85 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:38.523992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72922059-d3fd-4669-bbcb-48d3c8529f85 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:38.556841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd6314-b20f-4339-ab56-a156ad9c8550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:38.557691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd6314-b20f-4339-ab56-a156ad9c8550 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:38.557975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd6314-b20f-4339-ab56-a156ad9c8550 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:38.558249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd6314-b20f-4339-ab56-a156ad9c8550 None admin] PATH_INFO: `/v3/projects/572efe1d1fca4ee6a6e37e847a934703` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:38.559450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd6314-b20f-4339-ab56-a156ad9c8550 None admin] RBAC: Authorizing `identity:get_project(project_id=572efe1d1fca4ee6a6e37e847a934703)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:38.560866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd6314-b20f-4339-ab56-a156ad9c8550 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:38.562557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 579/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jun 7 14:10:38 2022] GET /identity/v3/projects/572efe1d1fca4ee6a6e37e847a934703 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:38.568687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166f99-4aaa-4b0d-867e-c1d774c37934 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:10:38.628257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:38.665376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be166f99-4aaa-4b0d-867e-c1d774c37934 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:10:38.697641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcf7d2-4ec5-49dc-b6a7-6673dfa8ada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:10:38.698231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcf7d2-4ec5-49dc-b6a7-6673dfa8ada0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:10:38.698515 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcf7d2-4ec5-49dc-b6a7-6673dfa8ada0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:10:38.698792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcf7d2-4ec5-49dc-b6a7-6673dfa8ada0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:10:38.699654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcf7d2-4ec5-49dc-b6a7-6673dfa8ada0 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=572efe1d1fca4ee6a6e37e847a934703, user.id=178c285835c64357a999ec1970e46679) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:10:38.699967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcf7d2-4ec5-49dc-b6a7-6673dfa8ada0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:10:38.701642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcf7d2-4ec5-49dc-b6a7-6673dfa8ada0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:10:38.707844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 621/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:10:38 2022] GET /identity/v3/role_assignments?user.id=178c285835c64357a999ec1970e46679&scope.project.id=572efe1d1fca4ee6a6e37e847a934703&role.id=c6577847f998435991dac5744a94d0ee => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:10:48.552748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=78 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:10:48.704702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=36 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:39.175032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c6757-2f3d-44d0-a979-b3884aeb3f84 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:39.175869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c6757-2f3d-44d0-a979-b3884aeb3f84 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:39.175869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c6757-2f3d-44d0-a979-b3884aeb3f84 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:39.177267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 580/1201] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:11:39.182413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab19d0-e15b-4af6-8658-4562ed1bb193 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:39.182904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab19d0-e15b-4af6-8658-4562ed1bb193 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:39.183017 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab19d0-e15b-4af6-8658-4562ed1bb193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:39.203734 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-97ab19d0-e15b-4af6-8658-4562ed1bb193 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:11:39.205356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-97ab19d0-e15b-4af6-8658-4562ed1bb193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:11:39.286117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 622/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:11:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:11:39.311377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c6757-2f3d-44d0-a979-b3884aeb3f84 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:39.441516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c6757-2f3d-44d0-a979-b3884aeb3f84 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:39.483990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595be709-503c-4224-bf14-d1d3fb637a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:39.484780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595be709-503c-4224-bf14-d1d3fb637a8f None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:39.485052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595be709-503c-4224-bf14-d1d3fb637a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:39.485330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595be709-503c-4224-bf14-d1d3fb637a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:39.498609 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595be709-503c-4224-bf14-d1d3fb637a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:39.500264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595be709-503c-4224-bf14-d1d3fb637a8f None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-595be709-503c-4224-bf14-d1d3fb637a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:11:39.521584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:39.522690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:39.528335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:11:39.528335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:11:39.528335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:39.528335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:11:39.528335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 581/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:39.529585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab19d0-e15b-4af6-8658-4562ed1bb193 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:39.664008 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab19d0-e15b-4af6-8658-4562ed1bb193 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:39.699542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:39.711469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85746e0b-ea9a-4a63-90af-e414c86b9e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:39.712181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746e0b-ea9a-4a63-90af-e414c86b9e73 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:39.712465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746e0b-ea9a-4a63-90af-e414c86b9e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:39.712981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85746e0b-ea9a-4a63-90af-e414c86b9e73 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:39.713605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85746e0b-ea9a-4a63-90af-e414c86b9e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:39.713958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85746e0b-ea9a-4a63-90af-e414c86b9e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:39.715323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85746e0b-ea9a-4a63-90af-e414c86b9e73 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:39.741118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 623/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:39.747439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595be709-503c-4224-bf14-d1d3fb637a8f None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:39.814870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:39.882625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595be709-503c-4224-bf14-d1d3fb637a8f None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:39.928522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a2cef-2a54-4fc6-9028-577fc15514a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:39.929477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a2cef-2a54-4fc6-9028-577fc15514a5 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:39.929922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a2cef-2a54-4fc6-9028-577fc15514a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:39.930348 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a2cef-2a54-4fc6-9028-577fc15514a5 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:39.931256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a2cef-2a54-4fc6-9028-577fc15514a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:39.932719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a2cef-2a54-4fc6-9028-577fc15514a5 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:39.956470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 582/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jun 7 14:11:39 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:11:42.408948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2b1c-8ad6-4fae-8409-c1dd0da32154 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:42.409604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2b1c-8ad6-4fae-8409-c1dd0da32154 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:42.409604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2b1c-8ad6-4fae-8409-c1dd0da32154 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:42.411069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 624/1206] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:11:42.416217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff170-22fc-4071-9426-80c13b8c6768 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:42.416618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff170-22fc-4071-9426-80c13b8c6768 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:42.416800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ff170-22fc-4071-9426-80c13b8c6768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:42.435670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e96ff170-22fc-4071-9426-80c13b8c6768 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:11:42.436857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e96ff170-22fc-4071-9426-80c13b8c6768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:11:42.511445 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 583/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:11:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:11:42.536137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae2b1c-8ad6-4fae-8409-c1dd0da32154 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:42.656686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae2b1c-8ad6-4fae-8409-c1dd0da32154 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:42.701801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453b317-321c-4824-9daf-8314902ad246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:42.702018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453b317-321c-4824-9daf-8314902ad246 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:42.702195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453b317-321c-4824-9daf-8314902ad246 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:42.702429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453b317-321c-4824-9daf-8314902ad246 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:42.715962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453b317-321c-4824-9daf-8314902ad246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e453b317-321c-4824-9daf-8314902ad246 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:11:42.724846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:42.725930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:42.726843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 625/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:11:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:11:42.732602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff170-22fc-4071-9426-80c13b8c6768 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:42.795730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:42.899004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ff170-22fc-4071-9426-80c13b8c6768 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:42.949267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67757cf8-c023-490e-b623-fcff6e96da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:42.950020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67757cf8-c023-490e-b623-fcff6e96da26 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:42.950337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67757cf8-c023-490e-b623-fcff6e96da26 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:42.950563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67757cf8-c023-490e-b623-fcff6e96da26 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:42.951357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67757cf8-c023-490e-b623-fcff6e96da26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:42.951654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67757cf8-c023-490e-b623-fcff6e96da26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:42.953356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67757cf8-c023-490e-b623-fcff6e96da26 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:42.971392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 584/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:11:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:42.974807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453b317-321c-4824-9daf-8314902ad246 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:43.046465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:43.109384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453b317-321c-4824-9daf-8314902ad246 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:43.150308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d186f-f391-4d52-99bb-c5edd23769e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:43.151112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d186f-f391-4d52-99bb-c5edd23769e8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:43.151493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d186f-f391-4d52-99bb-c5edd23769e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:43.151775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d186f-f391-4d52-99bb-c5edd23769e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:43.163216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d186f-f391-4d52-99bb-c5edd23769e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:43.164689 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d186f-f391-4d52-99bb-c5edd23769e8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a59d186f-f391-4d52-99bb-c5edd23769e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:11:43.187410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:43.188611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:43.189675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:11:43.189675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:11:43.189675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:43.189675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:43.189675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 626/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:11:43.196083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67757cf8-c023-490e-b623-fcff6e96da26 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:43.326126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:43.333482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67757cf8-c023-490e-b623-fcff6e96da26 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:43.374892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9925dea-709f-4887-beba-9d0310afc2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:43.375712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9925dea-709f-4887-beba-9d0310afc2ad None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:43.376158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9925dea-709f-4887-beba-9d0310afc2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:43.376444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9925dea-709f-4887-beba-9d0310afc2ad None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:43.377466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9925dea-709f-4887-beba-9d0310afc2ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:43.377943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9925dea-709f-4887-beba-9d0310afc2ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:43.379553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9925dea-709f-4887-beba-9d0310afc2ad None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:43.397685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 585/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:43.404539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d186f-f391-4d52-99bb-c5edd23769e8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:43.522719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d186f-f391-4d52-99bb-c5edd23769e8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:43.524415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:43.567119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d7d36-6890-441d-8272-270afabc937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:43.568336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d7d36-6890-441d-8272-270afabc937a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:43.568687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d7d36-6890-441d-8272-270afabc937a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:43.569001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d7d36-6890-441d-8272-270afabc937a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:43.578084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d7d36-6890-441d-8272-270afabc937a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:43.579910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d7d36-6890-441d-8272-270afabc937a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-308d7d36-6890-441d-8272-270afabc937a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:11:43.598226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:43.599578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:11:43.600894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:43.604931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 627/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:11:43.606170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9925dea-709f-4887-beba-9d0310afc2ad None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:43.734237 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9925dea-709f-4887-beba-9d0310afc2ad None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:43.775031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b14166-b5b4-413c-a076-7017d6098484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:43.775954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b14166-b5b4-413c-a076-7017d6098484 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:43.776337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b14166-b5b4-413c-a076-7017d6098484 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:43.776661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b14166-b5b4-413c-a076-7017d6098484 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:43.777490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b14166-b5b4-413c-a076-7017d6098484 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:43.777891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b14166-b5b4-413c-a076-7017d6098484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:43.779495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b14166-b5b4-413c-a076-7017d6098484 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:43.798520 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 586/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jun 7 14:11:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:43.804109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d7d36-6890-441d-8272-270afabc937a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:43.921151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d7d36-6890-441d-8272-270afabc937a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:43.968603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2c32-8c98-4181-9556-ca637a28c58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:43.969576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2c32-8c98-4181-9556-ca637a28c58e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:43.970065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2c32-8c98-4181-9556-ca637a28c58e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:43.970479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be2c32-8c98-4181-9556-ca637a28c58e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:44.009287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:44.061651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be2c32-8c98-4181-9556-ca637a28c58e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:44.063467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be2c32-8c98-4181-9556-ca637a28c58e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:44.199125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 628/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:11:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:11:44.209061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b14166-b5b4-413c-a076-7017d6098484 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:44.231085 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:44.344443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b14166-b5b4-413c-a076-7017d6098484 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:44.386370 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6b9f-32d8-482e-80dc-cf7aecf6e341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:44.389129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6b9f-32d8-482e-80dc-cf7aecf6e341 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:44.389129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6b9f-32d8-482e-80dc-cf7aecf6e341 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:44.389129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6b9f-32d8-482e-80dc-cf7aecf6e341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:44.399937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a6b9f-32d8-482e-80dc-cf7aecf6e341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:44.401654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a6b9f-32d8-482e-80dc-cf7aecf6e341 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-435a6b9f-32d8-482e-80dc-cf7aecf6e341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:11:44.421985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:44.423104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:44.424334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:11:44.424334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:11:44.424334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:44.424334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:11:44.428950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 587/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:11:44.430204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2c32-8c98-4181-9556-ca637a28c58e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:44.496912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:44.536784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be2c32-8c98-4181-9556-ca637a28c58e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:44.575537 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a0abe-6e01-4fbd-b138-1ee483f7587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:44.576254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0abe-6e01-4fbd-b138-1ee483f7587f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:44.576674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0abe-6e01-4fbd-b138-1ee483f7587f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:44.576951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0abe-6e01-4fbd-b138-1ee483f7587f None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:44.577683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a0abe-6e01-4fbd-b138-1ee483f7587f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:44.578301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a0abe-6e01-4fbd-b138-1ee483f7587f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:44.579743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a0abe-6e01-4fbd-b138-1ee483f7587f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:44.593297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 629/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:44.598689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6b9f-32d8-482e-80dc-cf7aecf6e341 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:44.682125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:44.718990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6b9f-32d8-482e-80dc-cf7aecf6e341 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:44.757676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51696f-ae3e-4310-960c-3347e17c6203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:44.758504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51696f-ae3e-4310-960c-3347e17c6203 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:44.758877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51696f-ae3e-4310-960c-3347e17c6203 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:44.759115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51696f-ae3e-4310-960c-3347e17c6203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:44.766321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51696f-ae3e-4310-960c-3347e17c6203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:44.768657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51696f-ae3e-4310-960c-3347e17c6203 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-7c51696f-ae3e-4310-960c-3347e17c6203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:11:44.783636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:44.784661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:44.785562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:11:44.785562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:11:44.785562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:11:44.785562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:11:44.785562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:11:44.785562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:11:44.785562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:11:44.785562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:11:44.785562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 588/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:44.791523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a0abe-6e01-4fbd-b138-1ee483f7587f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:44.910199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a0abe-6e01-4fbd-b138-1ee483f7587f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:44.938342 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:44.954895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab41541-391a-42c5-91a0-307c9f2dba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:44.955635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41541-391a-42c5-91a0-307c9f2dba14 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:44.955927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41541-391a-42c5-91a0-307c9f2dba14 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:44.956203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41541-391a-42c5-91a0-307c9f2dba14 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:44.956999 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab41541-391a-42c5-91a0-307c9f2dba14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:44.957311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab41541-391a-42c5-91a0-307c9f2dba14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:44.958811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab41541-391a-42c5-91a0-307c9f2dba14 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:44.975496 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 630/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:11:44.984186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51696f-ae3e-4310-960c-3347e17c6203 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:45.102691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51696f-ae3e-4310-960c-3347e17c6203 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:45.138676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:45.148360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6549cf-bea3-4838-a1d8-973a1d22a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:45.149207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6549cf-bea3-4838-a1d8-973a1d22a984 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:45.149555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6549cf-bea3-4838-a1d8-973a1d22a984 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:45.149818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6549cf-bea3-4838-a1d8-973a1d22a984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:45.151758 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6549cf-bea3-4838-a1d8-973a1d22a984 None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=a0cc577feba04e66b950a69b918d4ea1) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:45.151758 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6549cf-bea3-4838-a1d8-973a1d22a984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:45.152576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6549cf-bea3-4838-a1d8-973a1d22a984 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:45.160015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 589/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:11:44 2022] GET /identity/v3/role_assignments?user.id=a0cc577feba04e66b950a69b918d4ea1&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:47.432058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810e1d5-70ab-49ae-9c0a-281baa5b7971 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:47.432586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810e1d5-70ab-49ae-9c0a-281baa5b7971 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:47.432692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810e1d5-70ab-49ae-9c0a-281baa5b7971 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:47.434011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 631/1220] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:11:47.439190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bde9b-5a98-4f7d-8ad0-c5fa122ad2e9 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:47.440191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bde9b-5a98-4f7d-8ad0-c5fa122ad2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:47.440362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bde9b-5a98-4f7d-8ad0-c5fa122ad2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:47.457909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-f28bde9b-5a98-4f7d-8ad0-c5fa122ad2e9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:11:47.459097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f28bde9b-5a98-4f7d-8ad0-c5fa122ad2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:11:47.540271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 590/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:11:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:11:47.563016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810e1d5-70ab-49ae-9c0a-281baa5b7971 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:47.676483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810e1d5-70ab-49ae-9c0a-281baa5b7971 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:47.715109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591e1e3-4eab-406a-8452-82d6c99e927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:47.715916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591e1e3-4eab-406a-8452-82d6c99e927f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:47.716204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591e1e3-4eab-406a-8452-82d6c99e927f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:47.716480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591e1e3-4eab-406a-8452-82d6c99e927f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:47.728212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591e1e3-4eab-406a-8452-82d6c99e927f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-4591e1e3-4eab-406a-8452-82d6c99e927f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:11:47.736093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:47.737065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:47.737922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 632/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:11:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:47.743952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bde9b-5a98-4f7d-8ad0-c5fa122ad2e9 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:47.856380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bde9b-5a98-4f7d-8ad0-c5fa122ad2e9 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:47.883821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:47.895835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c69e45-291e-4906-b9f6-b1d940a4c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:47.896516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c69e45-291e-4906-b9f6-b1d940a4c4fa None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:47.896800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c69e45-291e-4906-b9f6-b1d940a4c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:47.897072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c69e45-291e-4906-b9f6-b1d940a4c4fa None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:47.897832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c69e45-291e-4906-b9f6-b1d940a4c4fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:47.898139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c69e45-291e-4906-b9f6-b1d940a4c4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:47.899610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c69e45-291e-4906-b9f6-b1d940a4c4fa None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:47.908237 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 591/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:11:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:47.914167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591e1e3-4eab-406a-8452-82d6c99e927f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:47.964821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:48.027811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591e1e3-4eab-406a-8452-82d6c99e927f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:48.067484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f1e9-74c5-4cd2-b4c0-f5f32b517e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:48.068708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f1e9-74c5-4cd2-b4c0-f5f32b517e03 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:48.069227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f1e9-74c5-4cd2-b4c0-f5f32b517e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:48.069648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f1e9-74c5-4cd2-b4c0-f5f32b517e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:48.082374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7f1e9-74c5-4cd2-b4c0-f5f32b517e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:48.083877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7f1e9-74c5-4cd2-b4c0-f5f32b517e03 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-51f7f1e9-74c5-4cd2-b4c0-f5f32b517e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:11:48.102180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:48.103325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:48.104435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:11:48.104435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:11:48.104435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:48.104435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:48.104435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 633/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:48.109494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c69e45-291e-4906-b9f6-b1d940a4c4fa None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:48.252676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c69e45-291e-4906-b9f6-b1d940a4c4fa None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:48.298949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196a88f-ef42-440e-8732-97e563cb7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:48.300390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196a88f-ef42-440e-8732-97e563cb7b57 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:48.300752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196a88f-ef42-440e-8732-97e563cb7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:48.301049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196a88f-ef42-440e-8732-97e563cb7b57 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:48.302018 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196a88f-ef42-440e-8732-97e563cb7b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:48.302331 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196a88f-ef42-440e-8732-97e563cb7b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:48.303854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196a88f-ef42-440e-8732-97e563cb7b57 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:48.319165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 592/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:48.326266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f1e9-74c5-4cd2-b4c0-f5f32b517e03 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:48.437091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:48.444361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f1e9-74c5-4cd2-b4c0-f5f32b517e03 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:48.479963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee0000-7013-4eb3-964e-ea46ef4323d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:48.480775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee0000-7013-4eb3-964e-ea46ef4323d3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:48.481062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee0000-7013-4eb3-964e-ea46ef4323d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:48.481417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee0000-7013-4eb3-964e-ea46ef4323d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:48.490516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee0000-7013-4eb3-964e-ea46ef4323d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:48.492290 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee0000-7013-4eb3-964e-ea46ef4323d3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-9eee0000-7013-4eb3-964e-ea46ef4323d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:11:48.507352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:48.508571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:48.509924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 634/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:48.514439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196a88f-ef42-440e-8732-97e563cb7b57 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:48.565104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:48.623645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196a88f-ef42-440e-8732-97e563cb7b57 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:48.665053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3f6a9-e42b-47de-8bb9-b03f702d7d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:48.665728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3f6a9-e42b-47de-8bb9-b03f702d7d34 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:48.666011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3f6a9-e42b-47de-8bb9-b03f702d7d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:48.666288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3f6a9-e42b-47de-8bb9-b03f702d7d34 None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:48.667133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3f6a9-e42b-47de-8bb9-b03f702d7d34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:48.667489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3f6a9-e42b-47de-8bb9-b03f702d7d34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:48.668917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3f6a9-e42b-47de-8bb9-b03f702d7d34 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:48.687790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 593/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jun 7 14:11:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:11:48.693749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee0000-7013-4eb3-964e-ea46ef4323d3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:48.803581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee0000-7013-4eb3-964e-ea46ef4323d3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:48.840747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cfcf9-8c62-42b7-87fd-da48afe4b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:48.841478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cfcf9-8c62-42b7-87fd-da48afe4b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:48.841759 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cfcf9-8c62-42b7-87fd-da48afe4b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:48.842030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cfcf9-8c62-42b7-87fd-da48afe4b2c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:48.852419 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cfcf9-8c62-42b7-87fd-da48afe4b2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:48.853848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cfcf9-8c62-42b7-87fd-da48afe4b2c8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-fc4cfcf9-8c62-42b7-87fd-da48afe4b2c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:11:48.871728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:48.872695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:48.873608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:11:48.873608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:11:48.873608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:48.873608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:48.873608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 635/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:11:48.879503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3f6a9-e42b-47de-8bb9-b03f702d7d34 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:48.986258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3f6a9-e42b-47de-8bb9-b03f702d7d34 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:48.988925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:49.026701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfc32e-df87-4017-89f3-96c4082c6b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:49.027393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfc32e-df87-4017-89f3-96c4082c6b48 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:49.027679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfc32e-df87-4017-89f3-96c4082c6b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:49.027955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfc32e-df87-4017-89f3-96c4082c6b48 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:49.028680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfc32e-df87-4017-89f3-96c4082c6b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:49.028986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfc32e-df87-4017-89f3-96c4082c6b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:49.030353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcfc32e-df87-4017-89f3-96c4082c6b48 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:49.043253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 594/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:11:49.048940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cfcf9-8c62-42b7-87fd-da48afe4b2c8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:49.058902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:49.153653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cfcf9-8c62-42b7-87fd-da48afe4b2c8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:49.191440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fb173-f2e0-43ae-bfc0-91be2f851475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:49.192244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fb173-f2e0-43ae-bfc0-91be2f851475 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:49.192569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fb173-f2e0-43ae-bfc0-91be2f851475 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:49.192851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fb173-f2e0-43ae-bfc0-91be2f851475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:49.199873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fb173-f2e0-43ae-bfc0-91be2f851475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:49.201392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fb173-f2e0-43ae-bfc0-91be2f851475 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-9e2fb173-f2e0-43ae-bfc0-91be2f851475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:11:49.220088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:49.221240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:49.222240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:11:49.222240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:11:49.222240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:11:49.222240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:11:49.222240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:11:49.222240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:11:49.222240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:11:49.222240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:49.222240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 636/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:11:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:49.228586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfc32e-df87-4017-89f3-96c4082c6b48 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:49.350064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfc32e-df87-4017-89f3-96c4082c6b48 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:49.387728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf644a4-4909-4971-a661-bb10cb85eaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:49.388405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf644a4-4909-4971-a661-bb10cb85eaaa None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:49.388718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf644a4-4909-4971-a661-bb10cb85eaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:49.388968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf644a4-4909-4971-a661-bb10cb85eaaa None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:49.389858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf644a4-4909-4971-a661-bb10cb85eaaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:49.390209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf644a4-4909-4971-a661-bb10cb85eaaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:49.391669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf644a4-4909-4971-a661-bb10cb85eaaa None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:49.404129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 595/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:11:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:49.410170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fb173-f2e0-43ae-bfc0-91be2f851475 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:49.481711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:49.520287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fb173-f2e0-43ae-bfc0-91be2f851475 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:49.554610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebe354-5ca2-47bd-a740-271e54a4bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:49.555538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe354-5ca2-47bd-a740-271e54a4bfa0 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:49.555818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe354-5ca2-47bd-a740-271e54a4bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:49.556092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe354-5ca2-47bd-a740-271e54a4bfa0 None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/a0cc577feba04e66b950a69b918d4ea1/roles/f1f290999a44482b8242439dfe27b3e2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:49.572222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebe354-5ca2-47bd-a740-271e54a4bfa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=a0cc577feba04e66b950a69b918d4ea1, role_id=f1f290999a44482b8242439dfe27b3e2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:49.573673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebe354-5ca2-47bd-a740-271e54a4bfa0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:49.587614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 637/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:11:49 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/a0cc577feba04e66b950a69b918d4ea1/roles/f1f290999a44482b8242439dfe27b3e2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:11:51.894534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499222e-043d-48e6-96d8-9b92c928a505 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:51.895087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499222e-043d-48e6-96d8-9b92c928a505 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:51.895212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499222e-043d-48e6-96d8-9b92c928a505 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:51.896909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 596/1233] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:11:51.902096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd69e0-102f-4dee-8e83-1e06224525bd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:51.902502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd69e0-102f-4dee-8e83-1e06224525bd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:51.902652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd69e0-102f-4dee-8e83-1e06224525bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:51.920152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e6dd69e0-102f-4dee-8e83-1e06224525bd None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:11:51.921544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e6dd69e0-102f-4dee-8e83-1e06224525bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:11:51.992273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 638/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:11:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:11:52.018630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499222e-043d-48e6-96d8-9b92c928a505 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:52.044700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:52.126995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499222e-043d-48e6-96d8-9b92c928a505 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:52.176103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b9bab-d905-4972-bd1a-426bd4188b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:52.177152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b9bab-d905-4972-bd1a-426bd4188b1e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:52.177547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b9bab-d905-4972-bd1a-426bd4188b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:52.177942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b9bab-d905-4972-bd1a-426bd4188b1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:52.190454 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b9bab-d905-4972-bd1a-426bd4188b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-ad8b9bab-d905-4972-bd1a-426bd4188b1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:11:52.201549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:52.203954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:11:52.205816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 597/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jun 7 14:11:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:52.210194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd69e0-102f-4dee-8e83-1e06224525bd None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:52.264317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:52.330766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd69e0-102f-4dee-8e83-1e06224525bd None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:52.371163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9087e6-4f41-40fb-a077-edcd89f7cd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:52.372059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9087e6-4f41-40fb-a077-edcd89f7cd08 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:52.372353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9087e6-4f41-40fb-a077-edcd89f7cd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:52.372701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9087e6-4f41-40fb-a077-edcd89f7cd08 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:52.373563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9087e6-4f41-40fb-a077-edcd89f7cd08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:52.374022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9087e6-4f41-40fb-a077-edcd89f7cd08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:52.376199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9087e6-4f41-40fb-a077-edcd89f7cd08 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:52.387147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 639/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jun 7 14:11:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:52.393808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b9bab-d905-4972-bd1a-426bd4188b1e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:52.496530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:52.515307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b9bab-d905-4972-bd1a-426bd4188b1e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:52.553009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde899a-5c67-4cc3-af37-ed60a9d5dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:52.553808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde899a-5c67-4cc3-af37-ed60a9d5dc97 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:52.554098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde899a-5c67-4cc3-af37-ed60a9d5dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:52.554379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde899a-5c67-4cc3-af37-ed60a9d5dc97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:52.565680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde899a-5c67-4cc3-af37-ed60a9d5dc97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:52.567319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde899a-5c67-4cc3-af37-ed60a9d5dc97 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-bdde899a-5c67-4cc3-af37-ed60a9d5dc97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:11:52.588173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:52.589211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:52.590122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:11:52.590122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:11:52.590122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:52.590122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:11:52.590122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 598/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:52.595617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9087e6-4f41-40fb-a077-edcd89f7cd08 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:52.698272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9087e6-4f41-40fb-a077-edcd89f7cd08 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:52.710055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:52.740266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2043790-cb87-4add-8dc8-6a17da404efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:52.740978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2043790-cb87-4add-8dc8-6a17da404efa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:52.741272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2043790-cb87-4add-8dc8-6a17da404efa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:52.741558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2043790-cb87-4add-8dc8-6a17da404efa None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:52.742297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2043790-cb87-4add-8dc8-6a17da404efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:52.742611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2043790-cb87-4add-8dc8-6a17da404efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:52.744085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2043790-cb87-4add-8dc8-6a17da404efa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:52.756538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 640/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:52.762307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde899a-5c67-4cc3-af37-ed60a9d5dc97 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:52.873799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde899a-5c67-4cc3-af37-ed60a9d5dc97 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:52.910898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ceee1-5926-4304-9fdf-86465f7f5241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:52.911778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ceee1-5926-4304-9fdf-86465f7f5241 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:52.912102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ceee1-5926-4304-9fdf-86465f7f5241 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:52.912357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ceee1-5926-4304-9fdf-86465f7f5241 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:52.915431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:52.921787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ceee1-5926-4304-9fdf-86465f7f5241 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:52.923412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ceee1-5926-4304-9fdf-86465f7f5241 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-d76ceee1-5926-4304-9fdf-86465f7f5241 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:11:52.938243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:52.940040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:11:52.946592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 599/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:11:52.947301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2043790-cb87-4add-8dc8-6a17da404efa None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:53.053291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2043790-cb87-4add-8dc8-6a17da404efa None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:53.089790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e72f8-0da0-4862-9814-f2feff4ffdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:53.090584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e72f8-0da0-4862-9814-f2feff4ffdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:53.090838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e72f8-0da0-4862-9814-f2feff4ffdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:53.091193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e72f8-0da0-4862-9814-f2feff4ffdb0 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:53.092188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e72f8-0da0-4862-9814-f2feff4ffdb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:53.092603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e72f8-0da0-4862-9814-f2feff4ffdb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:53.094382 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e72f8-0da0-4862-9814-f2feff4ffdb0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:53.114484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 641/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jun 7 14:11:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:11:53.120578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ceee1-5926-4304-9fdf-86465f7f5241 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:53.235561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ceee1-5926-4304-9fdf-86465f7f5241 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:53.275131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f703e40-0867-4077-97ef-4f6e52ed1e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:53.275993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f703e40-0867-4077-97ef-4f6e52ed1e31 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:53.276314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f703e40-0867-4077-97ef-4f6e52ed1e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:53.276629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f703e40-0867-4077-97ef-4f6e52ed1e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:53.349596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:53.356831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f703e40-0867-4077-97ef-4f6e52ed1e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:53.358289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f703e40-0867-4077-97ef-4f6e52ed1e31 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:53.460840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 600/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:11:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 07 14:11:53.466695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e72f8-0da0-4862-9814-f2feff4ffdb0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:53.495456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:53.575224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e72f8-0da0-4862-9814-f2feff4ffdb0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:53.612504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39297eb5-1f42-4c12-8477-da19b3ea24fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:53.613252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39297eb5-1f42-4c12-8477-da19b3ea24fb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:53.613532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39297eb5-1f42-4c12-8477-da19b3ea24fb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:53.613809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39297eb5-1f42-4c12-8477-da19b3ea24fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:53.624443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39297eb5-1f42-4c12-8477-da19b3ea24fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:53.625880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39297eb5-1f42-4c12-8477-da19b3ea24fb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-39297eb5-1f42-4c12-8477-da19b3ea24fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:11:53.644703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:53.645839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:53.646754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:11:53.646754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:11:53.646754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:53.646754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:53.646754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 642/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:11:53.651596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f703e40-0867-4077-97ef-4f6e52ed1e31 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:53.758088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:53.764761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f703e40-0867-4077-97ef-4f6e52ed1e31 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:53.801853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd39b6-2180-427a-b870-2e5425ff2cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:53.802519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd39b6-2180-427a-b870-2e5425ff2cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:53.802802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd39b6-2180-427a-b870-2e5425ff2cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:53.803102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd39b6-2180-427a-b870-2e5425ff2cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:53.803855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd39b6-2180-427a-b870-2e5425ff2cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:53.804161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd39b6-2180-427a-b870-2e5425ff2cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:53.805719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd39b6-2180-427a-b870-2e5425ff2cc2 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:53.818543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 601/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:53.825415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39297eb5-1f42-4c12-8477-da19b3ea24fb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:53.911911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:53.935713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39297eb5-1f42-4c12-8477-da19b3ea24fb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:53.974324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a295e9-6798-4a9c-959d-d2257f48e584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:53.975364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a295e9-6798-4a9c-959d-d2257f48e584 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:53.975687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a295e9-6798-4a9c-959d-d2257f48e584 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:53.975970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a295e9-6798-4a9c-959d-d2257f48e584 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:53.983887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a295e9-6798-4a9c-959d-d2257f48e584 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:53.985354 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a295e9-6798-4a9c-959d-d2257f48e584 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-89a295e9-6798-4a9c-959d-d2257f48e584 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:11:54.001180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:54.002731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:54.003682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:11:54.003682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:11:54.003682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:11:54.003682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:11:54.003682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:11:54.003682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:11:54.003682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:11:54.003682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:54.003682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 643/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:11:54.009573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd39b6-2180-427a-b870-2e5425ff2cc2 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:54.119093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd39b6-2180-427a-b870-2e5425ff2cc2 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:54.154029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30930068-8908-4987-afb9-70daceb38977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:54.154696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930068-8908-4987-afb9-70daceb38977 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:54.154984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930068-8908-4987-afb9-70daceb38977 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:54.155262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30930068-8908-4987-afb9-70daceb38977 None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:54.156132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30930068-8908-4987-afb9-70daceb38977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:54.156448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30930068-8908-4987-afb9-70daceb38977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:54.157847 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30930068-8908-4987-afb9-70daceb38977 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:54.170759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 602/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:11:54.177604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a295e9-6798-4a9c-959d-d2257f48e584 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:54.292693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a295e9-6798-4a9c-959d-d2257f48e584 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:54.330912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e262a-ddb9-4df9-b98e-b9a49d6121b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:54.331548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e262a-ddb9-4df9-b98e-b9a49d6121b1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:54.331875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e262a-ddb9-4df9-b98e-b9a49d6121b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:54.332119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e262a-ddb9-4df9-b98e-b9a49d6121b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:54.332971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e262a-ddb9-4df9-b98e-b9a49d6121b1 None admin] RBAC: Adding query filter params (role.id=f1f290999a44482b8242439dfe27b3e2, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=a0cc577feba04e66b950a69b918d4ea1) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:54.333289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e262a-ddb9-4df9-b98e-b9a49d6121b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:54.334791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e262a-ddb9-4df9-b98e-b9a49d6121b1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:54.341449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 644/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:11:54 2022] GET /identity/v3/role_assignments?user.id=a0cc577feba04e66b950a69b918d4ea1&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=f1f290999a44482b8242439dfe27b3e2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:56.749624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffd643-522c-42d5-bcaf-5d7b88ceec0e None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:56.750163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffd643-522c-42d5-bcaf-5d7b88ceec0e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:56.750163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffd643-522c-42d5-bcaf-5d7b88ceec0e None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:56.751515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 603/1247] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:11:56.756958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f910c68-c8ad-4d59-aca7-6015f1546817 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:56.757383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f910c68-c8ad-4d59-aca7-6015f1546817 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:56.757530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f910c68-c8ad-4d59-aca7-6015f1546817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:56.763160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:56.777134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3f910c68-c8ad-4d59-aca7-6015f1546817 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:11:56.778300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3f910c68-c8ad-4d59-aca7-6015f1546817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:11:56.852331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 645/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:11:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:11:56.875824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffd643-522c-42d5-bcaf-5d7b88ceec0e None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:56.896148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:56.987539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffd643-522c-42d5-bcaf-5d7b88ceec0e None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:57.027463 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0897a04-af7f-4daf-95dd-d29db9e14d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:57.028625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0897a04-af7f-4daf-95dd-d29db9e14d1e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:57.028896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0897a04-af7f-4daf-95dd-d29db9e14d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:57.029217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0897a04-af7f-4daf-95dd-d29db9e14d1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:57.040844 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0897a04-af7f-4daf-95dd-d29db9e14d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-b0897a04-af7f-4daf-95dd-d29db9e14d1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:11:57.049200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:57.050218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:11:57.051551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 604/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 07 14:11:57.057202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f910c68-c8ad-4d59-aca7-6015f1546817 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:57.157197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f910c68-c8ad-4d59-aca7-6015f1546817 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:57.193241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:57.198895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e59438-aa6a-4fd5-a949-22770dc1c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:57.199606 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e59438-aa6a-4fd5-a949-22770dc1c7ee None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:57.200110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e59438-aa6a-4fd5-a949-22770dc1c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:57.200426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e59438-aa6a-4fd5-a949-22770dc1c7ee None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:57.201263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e59438-aa6a-4fd5-a949-22770dc1c7ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:57.201595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e59438-aa6a-4fd5-a949-22770dc1c7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:57.203251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e59438-aa6a-4fd5-a949-22770dc1c7ee None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:57.212944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 646/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:11:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:57.218369 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0897a04-af7f-4daf-95dd-d29db9e14d1e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:57.307472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:57.334942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0897a04-af7f-4daf-95dd-d29db9e14d1e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:57.373846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f8442-8f6e-4462-8b82-743e9a1ca4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:57.374782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f8442-8f6e-4462-8b82-743e9a1ca4aa None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:57.375132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f8442-8f6e-4462-8b82-743e9a1ca4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:57.375461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f8442-8f6e-4462-8b82-743e9a1ca4aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:57.387471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f8442-8f6e-4462-8b82-743e9a1ca4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:57.388914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f8442-8f6e-4462-8b82-743e9a1ca4aa None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-675f8442-8f6e-4462-8b82-743e9a1ca4aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:11:57.408407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:57.409535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:57.410574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:11:57.410574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:11:57.410574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:57.410574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:11:57.410574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 605/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:57.415750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e59438-aa6a-4fd5-a949-22770dc1c7ee None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:57.521823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e59438-aa6a-4fd5-a949-22770dc1c7ee None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:57.555628 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecc564-dafc-467b-999b-95b576d1c844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:57.556594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecc564-dafc-467b-999b-95b576d1c844 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:57.556900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecc564-dafc-467b-999b-95b576d1c844 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:57.557176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecc564-dafc-467b-999b-95b576d1c844 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:57.557949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecc564-dafc-467b-999b-95b576d1c844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:57.558200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecc564-dafc-467b-999b-95b576d1c844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:57.559572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecc564-dafc-467b-999b-95b576d1c844 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:57.572561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 647/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:57.578550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f8442-8f6e-4462-8b82-743e9a1ca4aa None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:57.680726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f8442-8f6e-4462-8b82-743e9a1ca4aa None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:57.707636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:57.716660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3edfc-ff8e-4e63-b1f8-b2c024ecced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:57.717606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3edfc-ff8e-4e63-b1f8-b2c024ecced2 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:57.718108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3edfc-ff8e-4e63-b1f8-b2c024ecced2 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:57.718360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3edfc-ff8e-4e63-b1f8-b2c024ecced2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:57.726535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3edfc-ff8e-4e63-b1f8-b2c024ecced2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:57.728134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3edfc-ff8e-4e63-b1f8-b2c024ecced2 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-26a3edfc-ff8e-4e63-b1f8-b2c024ecced2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:11:57.743051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:57.744293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:11:57.745261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 606/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:57.751354 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecc564-dafc-467b-999b-95b576d1c844 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:57.813033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:57.860431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecc564-dafc-467b-999b-95b576d1c844 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:57.896926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f465236-4386-4026-8e60-7a282c58cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:57.897594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f465236-4386-4026-8e60-7a282c58cbab None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:57.897877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f465236-4386-4026-8e60-7a282c58cbab None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:57.898152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f465236-4386-4026-8e60-7a282c58cbab None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:57.899027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f465236-4386-4026-8e60-7a282c58cbab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:57.899370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f465236-4386-4026-8e60-7a282c58cbab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:57.900793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f465236-4386-4026-8e60-7a282c58cbab None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:57.918235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 648/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jun 7 14:11:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:57.924597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3edfc-ff8e-4e63-b1f8-b2c024ecced2 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:58.030343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3edfc-ff8e-4e63-b1f8-b2c024ecced2 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:58.065766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567e878-08e0-4be1-a477-8c812ba48f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:58.066379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567e878-08e0-4be1-a477-8c812ba48f19 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:58.066669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567e878-08e0-4be1-a477-8c812ba48f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:58.066947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567e878-08e0-4be1-a477-8c812ba48f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:58.124210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:58.139592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567e878-08e0-4be1-a477-8c812ba48f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:58.141222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567e878-08e0-4be1-a477-8c812ba48f19 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:58.250082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 607/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:11:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:11:58.256511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f465236-4386-4026-8e60-7a282c58cbab None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:58.371819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f465236-4386-4026-8e60-7a282c58cbab None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:58.389318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:58.412298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdd045-4785-459b-9ea8-e68bcacf38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:58.413118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdd045-4785-459b-9ea8-e68bcacf38a3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:58.413400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdd045-4785-459b-9ea8-e68bcacf38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:58.413675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdd045-4785-459b-9ea8-e68bcacf38a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:58.425641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdd045-4785-459b-9ea8-e68bcacf38a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:58.427135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdd045-4785-459b-9ea8-e68bcacf38a3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d6fdd045-4785-459b-9ea8-e68bcacf38a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:11:58.446526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:58.447887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:58.448932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:11:58.448932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:11:58.448932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:11:58.448932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:58.448932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 649/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:58.453980 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567e878-08e0-4be1-a477-8c812ba48f19 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:58.547222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:58.561016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567e878-08e0-4be1-a477-8c812ba48f19 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:58.597331 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f31f4-036d-47d5-8209-13cac238efe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:58.598007 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f31f4-036d-47d5-8209-13cac238efe2 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:58.598292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f31f4-036d-47d5-8209-13cac238efe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:58.598567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f31f4-036d-47d5-8209-13cac238efe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:58.599308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f31f4-036d-47d5-8209-13cac238efe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:58.599645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f31f4-036d-47d5-8209-13cac238efe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:58.601035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f31f4-036d-47d5-8209-13cac238efe2 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:58.618046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 608/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:58.619535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdd045-4785-459b-9ea8-e68bcacf38a3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:58.724270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdd045-4785-459b-9ea8-e68bcacf38a3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:58.760182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54c946-c6ea-4b79-80c8-acd6975cd1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:58.761000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54c946-c6ea-4b79-80c8-acd6975cd1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:58.761285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54c946-c6ea-4b79-80c8-acd6975cd1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:58.761563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54c946-c6ea-4b79-80c8-acd6975cd1e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:58.768997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54c946-c6ea-4b79-80c8-acd6975cd1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:58.770459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54c946-c6ea-4b79-80c8-acd6975cd1e2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-1b54c946-c6ea-4b79-80c8-acd6975cd1e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:11:58.785486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:11:58.786648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:11:58.792611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:11:58.792611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:11:58.792611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:11:58.792611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:11:58.792611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:11:58.792611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:11:58.792611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:11:58.792611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:11:58.792611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 650/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:11:58.794604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f31f4-036d-47d5-8209-13cac238efe2 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:58.895776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f31f4-036d-47d5-8209-13cac238efe2 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:58.930328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda5bee-3a29-42e3-ae2c-54bc0ebe260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:58.930994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda5bee-3a29-42e3-ae2c-54bc0ebe260a None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:58.931280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda5bee-3a29-42e3-ae2c-54bc0ebe260a None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:58.931646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda5bee-3a29-42e3-ae2c-54bc0ebe260a None admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:58.932449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda5bee-3a29-42e3-ae2c-54bc0ebe260a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:58.932761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda5bee-3a29-42e3-ae2c-54bc0ebe260a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:58.934190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda5bee-3a29-42e3-ae2c-54bc0ebe260a None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:58.946489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 609/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:11:58.952699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54c946-c6ea-4b79-80c8-acd6975cd1e2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:11:58.980517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:11:59.057696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54c946-c6ea-4b79-80c8-acd6975cd1e2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:11:59.090452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60016bf0-32aa-4bbe-bd72-5ab819982fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:11:59.091098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016bf0-32aa-4bbe-bd72-5ab819982fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:11:59.091403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016bf0-32aa-4bbe-bd72-5ab819982fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:11:59.091679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016bf0-32aa-4bbe-bd72-5ab819982fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:11:59.092503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016bf0-32aa-4bbe-bd72-5ab819982fa2 None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=a0cc577feba04e66b950a69b918d4ea1) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:11:59.092812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016bf0-32aa-4bbe-bd72-5ab819982fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:11:59.094237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016bf0-32aa-4bbe-bd72-5ab819982fa2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:11:59.100064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 651/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:11:58 2022] GET /identity/v3/role_assignments?user.id=a0cc577feba04e66b950a69b918d4ea1&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=c6577847f998435991dac5744a94d0ee => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:01.257861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f8db-2063-42ee-87ab-713e918dffd0 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:01.258385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f8db-2063-42ee-87ab-713e918dffd0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:01.258475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f8db-2063-42ee-87ab-713e918dffd0 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:01.259837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 610/1261] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:12:01.265448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace3e17-ceb4-46f4-b381-3f9966e6d0ff None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:01.265954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace3e17-ceb4-46f4-b381-3f9966e6d0ff None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:01.266047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace3e17-ceb4-46f4-b381-3f9966e6d0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:01.285816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0ace3e17-ceb4-46f4-b381-3f9966e6d0ff None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:12:01.287303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0ace3e17-ceb4-46f4-b381-3f9966e6d0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:12:01.359730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 652/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:12:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 07 14:12:01.382452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2f8db-2063-42ee-87ab-713e918dffd0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:01.393732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:01.480857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2f8db-2063-42ee-87ab-713e918dffd0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:01.513053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a83ca3-31fa-4473-addb-3045888cba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:01.513773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a83ca3-31fa-4473-addb-3045888cba4e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:01.514051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a83ca3-31fa-4473-addb-3045888cba4e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:01.514321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a83ca3-31fa-4473-addb-3045888cba4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:01.524601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a83ca3-31fa-4473-addb-3045888cba4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-f7a83ca3-31fa-4473-addb-3045888cba4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:12:01.532099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:01.533733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:12:01.534855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 611/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:12:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:01.539711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace3e17-ceb4-46f4-b381-3f9966e6d0ff None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:01.557268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:01.633927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace3e17-ceb4-46f4-b381-3f9966e6d0ff None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:01.666504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe90a7-af86-4c6c-be54-193379bb4df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:01.667147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe90a7-af86-4c6c-be54-193379bb4df3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:01.667456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe90a7-af86-4c6c-be54-193379bb4df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:01.667729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe90a7-af86-4c6c-be54-193379bb4df3 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:01.668462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe90a7-af86-4c6c-be54-193379bb4df3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:01.668763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe90a7-af86-4c6c-be54-193379bb4df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:01.670103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe90a7-af86-4c6c-be54-193379bb4df3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:01.677799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 653/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:12:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:01.683438 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a83ca3-31fa-4473-addb-3045888cba4e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:01.748282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:01.781539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a83ca3-31fa-4473-addb-3045888cba4e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:01.813351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b798ee-5b08-473f-9ead-d8da77064f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:01.814616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b798ee-5b08-473f-9ead-d8da77064f5c None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:01.814901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b798ee-5b08-473f-9ead-d8da77064f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:01.815177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b798ee-5b08-473f-9ead-d8da77064f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:01.825426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b798ee-5b08-473f-9ead-d8da77064f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:01.826861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b798ee-5b08-473f-9ead-d8da77064f5c None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-29b798ee-5b08-473f-9ead-d8da77064f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:12:01.844233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:01.845267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:01.846287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:12:01.846287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:12:01.846287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:12:01.846287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:12:01.846287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 612/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:01.850952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe90a7-af86-4c6c-be54-193379bb4df3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:01.927962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:01.947503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe90a7-af86-4c6c-be54-193379bb4df3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:01.980401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc692a2-c68d-4682-9127-2200a0a673f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:01.981051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc692a2-c68d-4682-9127-2200a0a673f3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:01.981335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc692a2-c68d-4682-9127-2200a0a673f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:01.981613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc692a2-c68d-4682-9127-2200a0a673f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:01.982336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc692a2-c68d-4682-9127-2200a0a673f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:01.982646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc692a2-c68d-4682-9127-2200a0a673f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:01.984038 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc692a2-c68d-4682-9127-2200a0a673f3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:01.996043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 654/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:12:02.002213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b798ee-5b08-473f-9ead-d8da77064f5c None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:02.100208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b798ee-5b08-473f-9ead-d8da77064f5c None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:02.119490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:02.133699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecf3b3-212d-4d5f-8b17-4b6f467f1545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:02.134490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecf3b3-212d-4d5f-8b17-4b6f467f1545 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:02.134773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecf3b3-212d-4d5f-8b17-4b6f467f1545 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:02.135049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecf3b3-212d-4d5f-8b17-4b6f467f1545 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:02.143155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecf3b3-212d-4d5f-8b17-4b6f467f1545 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:02.144627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecf3b3-212d-4d5f-8b17-4b6f467f1545 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-e5ecf3b3-212d-4d5f-8b17-4b6f467f1545 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:12:02.158636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:02.159781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:12:02.160772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 613/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:12:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:02.165700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc692a2-c68d-4682-9127-2200a0a673f3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:02.263613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc692a2-c68d-4682-9127-2200a0a673f3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:02.304728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4293e-7aa2-4883-a0b2-31fb226e816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:02.305524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4293e-7aa2-4883-a0b2-31fb226e816a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:02.305659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4293e-7aa2-4883-a0b2-31fb226e816a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:02.305934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4293e-7aa2-4883-a0b2-31fb226e816a None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:02.306768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4293e-7aa2-4883-a0b2-31fb226e816a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:02.307078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4293e-7aa2-4883-a0b2-31fb226e816a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:02.308532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4293e-7aa2-4883-a0b2-31fb226e816a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:02.317738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:02.326241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 655/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jun 7 14:12:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:02.332105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecf3b3-212d-4d5f-8b17-4b6f467f1545 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:02.429287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecf3b3-212d-4d5f-8b17-4b6f467f1545 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:02.461321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aec5b8-678f-4c4f-b794-06332cad8961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:02.462103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aec5b8-678f-4c4f-b794-06332cad8961 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:02.462389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aec5b8-678f-4c4f-b794-06332cad8961 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:02.462667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aec5b8-678f-4c4f-b794-06332cad8961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:02.473339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aec5b8-678f-4c4f-b794-06332cad8961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:02.474767 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aec5b8-678f-4c4f-b794-06332cad8961 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-a8aec5b8-678f-4c4f-b794-06332cad8961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:12:02.492181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:02.493293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:02.494894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:12:02.494894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:12:02.494894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:12:02.494894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:12:02.494894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 614/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:02.498917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4293e-7aa2-4883-a0b2-31fb226e816a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:02.596521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4293e-7aa2-4883-a0b2-31fb226e816a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:02.629395 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de2266-970b-4fa5-aab1-d52b7f7ce502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:02.630041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de2266-970b-4fa5-aab1-d52b7f7ce502 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:02.630325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de2266-970b-4fa5-aab1-d52b7f7ce502 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:02.630602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de2266-970b-4fa5-aab1-d52b7f7ce502 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:02.631325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de2266-970b-4fa5-aab1-d52b7f7ce502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:02.631661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de2266-970b-4fa5-aab1-d52b7f7ce502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:02.633015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de2266-970b-4fa5-aab1-d52b7f7ce502 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:02.643933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 656/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:02.649414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aec5b8-678f-4c4f-b794-06332cad8961 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:02.680944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:02.747404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aec5b8-678f-4c4f-b794-06332cad8961 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:02.780515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d51a9-807a-46b9-ba97-89fd6f91e796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:02.781297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d51a9-807a-46b9-ba97-89fd6f91e796 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:02.781579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d51a9-807a-46b9-ba97-89fd6f91e796 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:02.781853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d51a9-807a-46b9-ba97-89fd6f91e796 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:02.789020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d51a9-807a-46b9-ba97-89fd6f91e796 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:02.790442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d51a9-807a-46b9-ba97-89fd6f91e796 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-865d51a9-807a-46b9-ba97-89fd6f91e796 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:12:02.804688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:02.805759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:02.806734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:12:02.806734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:12:02.806734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:12:02.806734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:12:02.806734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:12:02.806734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:12:02.806734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:12:02.806734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:12:02.806734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 615/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:02.811535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de2266-970b-4fa5-aab1-d52b7f7ce502 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:02.868518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:02.909456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de2266-970b-4fa5-aab1-d52b7f7ce502 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:02.942292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49121-a948-4572-b48f-e9bc89fd2732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:02.942886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49121-a948-4572-b48f-e9bc89fd2732 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:02.943171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49121-a948-4572-b48f-e9bc89fd2732 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:02.943478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49121-a948-4572-b48f-e9bc89fd2732 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:02.944272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c49121-a948-4572-b48f-e9bc89fd2732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:02.944582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c49121-a948-4572-b48f-e9bc89fd2732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:02.945992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c49121-a948-4572-b48f-e9bc89fd2732 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:02.957778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 657/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:02.963510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d51a9-807a-46b9-ba97-89fd6f91e796 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:03.051573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:03.060318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d51a9-807a-46b9-ba97-89fd6f91e796 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:03.093453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7885b5-b963-4cae-a0aa-841c0085a885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:03.094328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7885b5-b963-4cae-a0aa-841c0085a885 None admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:03.094614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7885b5-b963-4cae-a0aa-841c0085a885 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:03.094892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7885b5-b963-4cae-a0aa-841c0085a885 None admin] PATH_INFO: `/v3/projects/3993f115eb5d49abac749d934f3ec449/users/a0cc577feba04e66b950a69b918d4ea1/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:03.096887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7885b5-b963-4cae-a0aa-841c0085a885 None admin] RBAC: Authorizing `identity:create_grant(project_id=3993f115eb5d49abac749d934f3ec449, user_id=a0cc577feba04e66b950a69b918d4ea1, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:03.098305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7885b5-b963-4cae-a0aa-841c0085a885 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:03.110156 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 616/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jun 7 14:12:02 2022] PUT /identity/v3/projects/3993f115eb5d49abac749d934f3ec449/users/a0cc577feba04e66b950a69b918d4ea1/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:12:05.309820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3598d-f3b9-4863-9259-cb5a0c3a85bb None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:05.310376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3598d-f3b9-4863-9259-cb5a0c3a85bb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:05.310376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3598d-f3b9-4863-9259-cb5a0c3a85bb None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:05.311781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 658/1274] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:12:05.317027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcbcac-2fd9-43a4-afa9-dd51283140bd None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:05.317461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcbcac-2fd9-43a4-afa9-dd51283140bd None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:05.317593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcbcac-2fd9-43a4-afa9-dd51283140bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:05.334815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-fbfcbcac-2fd9-43a4-afa9-dd51283140bd None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:12:05.336070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-fbfcbcac-2fd9-43a4-afa9-dd51283140bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:12:05.401081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 617/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:12:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:12:05.425067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3598d-f3b9-4863-9259-cb5a0c3a85bb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:05.525112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3598d-f3b9-4863-9259-cb5a0c3a85bb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:05.541703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:05.558119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b051d7d-7568-4462-bde8-7786c2dd9b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:05.558901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b051d7d-7568-4462-bde8-7786c2dd9b37 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:05.559186 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b051d7d-7568-4462-bde8-7786c2dd9b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:05.559494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b051d7d-7568-4462-bde8-7786c2dd9b37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:05.569837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b051d7d-7568-4462-bde8-7786c2dd9b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-7b051d7d-7568-4462-bde8-7786c2dd9b37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 07 14:12:05.577389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:05.578776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:05.580512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 659/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jun 7 14:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:05.585452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcbcac-2fd9-43a4-afa9-dd51283140bd None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:05.663584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:05.681677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcbcac-2fd9-43a4-afa9-dd51283140bd None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:05.716498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e20380-b75b-4955-bbbc-5d9c0530bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:05.717163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e20380-b75b-4955-bbbc-5d9c0530bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:05.717448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e20380-b75b-4955-bbbc-5d9c0530bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:05.717724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e20380-b75b-4955-bbbc-5d9c0530bbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:05.718472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e20380-b75b-4955-bbbc-5d9c0530bbe0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:05.718783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e20380-b75b-4955-bbbc-5d9c0530bbe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:05.720199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e20380-b75b-4955-bbbc-5d9c0530bbe0 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:05.728036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 618/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jun 7 14:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:05.733693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b051d7d-7568-4462-bde8-7786c2dd9b37 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:05.832700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b051d7d-7568-4462-bde8-7786c2dd9b37 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:05.865033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408efb56-c2b5-4085-9790-ba166b4f715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:05.865807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408efb56-c2b5-4085-9790-ba166b4f715e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:05.866089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408efb56-c2b5-4085-9790-ba166b4f715e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:05.866364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408efb56-c2b5-4085-9790-ba166b4f715e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:05.876570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408efb56-c2b5-4085-9790-ba166b4f715e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:05.878001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408efb56-c2b5-4085-9790-ba166b4f715e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-408efb56-c2b5-4085-9790-ba166b4f715e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:12:05.895011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:05.896098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:05.897320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:12:05.897320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:12:05.897320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:12:05.897320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:05.897320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 660/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:05.901767 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e20380-b75b-4955-bbbc-5d9c0530bbe0 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:05.999188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e20380-b75b-4955-bbbc-5d9c0530bbe0 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:06.031890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bbf2a-56bb-4e6a-9b67-b328e26273e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:06.032565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bbf2a-56bb-4e6a-9b67-b328e26273e2 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:06.032851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bbf2a-56bb-4e6a-9b67-b328e26273e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:06.033131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bbf2a-56bb-4e6a-9b67-b328e26273e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:06.033852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bbf2a-56bb-4e6a-9b67-b328e26273e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:06.034160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bbf2a-56bb-4e6a-9b67-b328e26273e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:06.035540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bbf2a-56bb-4e6a-9b67-b328e26273e2 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:06.046923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 619/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:06.052759 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408efb56-c2b5-4085-9790-ba166b4f715e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:06.083367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:06.150814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408efb56-c2b5-4085-9790-ba166b4f715e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:06.183931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ef4c6-1dc0-4600-a7bf-8fdce6b80f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:06.184717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ef4c6-1dc0-4600-a7bf-8fdce6b80f0b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:06.185001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ef4c6-1dc0-4600-a7bf-8fdce6b80f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:06.185276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ef4c6-1dc0-4600-a7bf-8fdce6b80f0b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:06.192512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ef4c6-1dc0-4600-a7bf-8fdce6b80f0b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:06.193936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ef4c6-1dc0-4600-a7bf-8fdce6b80f0b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ae6ef4c6-1dc0-4600-a7bf-8fdce6b80f0b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 07 14:12:06.208248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:06.213852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:06.215105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 661/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:12:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:06.215913 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bbf2a-56bb-4e6a-9b67-b328e26273e2 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:06.218922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:06.318555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bbf2a-56bb-4e6a-9b67-b328e26273e2 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:06.352315 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271597-5002-4d68-98c3-1bf46c8a6c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:06.352918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271597-5002-4d68-98c3-1bf46c8a6c3b None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:06.353201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271597-5002-4d68-98c3-1bf46c8a6c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:06.353479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271597-5002-4d68-98c3-1bf46c8a6c3b None admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:06.354318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0271597-5002-4d68-98c3-1bf46c8a6c3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:06.354628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0271597-5002-4d68-98c3-1bf46c8a6c3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:06.356113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0271597-5002-4d68-98c3-1bf46c8a6c3b None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:06.373151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 620/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jun 7 14:12:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:12:06.378973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ef4c6-1dc0-4600-a7bf-8fdce6b80f0b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:06.467022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:06.477219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ef4c6-1dc0-4600-a7bf-8fdce6b80f0b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:06.510196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4917a-3600-49ab-bdd4-4d1c2be1bccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:06.510842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4917a-3600-49ab-bdd4-4d1c2be1bccc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:06.511128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4917a-3600-49ab-bdd4-4d1c2be1bccc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:06.511442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4917a-3600-49ab-bdd4-4d1c2be1bccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:06.575723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4917a-3600-49ab-bdd4-4d1c2be1bccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:06.577140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4917a-3600-49ab-bdd4-4d1c2be1bccc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:06.661595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:06.671910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 662/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jun 7 14:12:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 07 14:12:06.678133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271597-5002-4d68-98c3-1bf46c8a6c3b None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:06.738319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:06.775771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271597-5002-4d68-98c3-1bf46c8a6c3b None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:06.808287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a63c3-4af8-4a63-9aa4-b739b51a0e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:06.809065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a63c3-4af8-4a63-9aa4-b739b51a0e2e None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:06.809349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a63c3-4af8-4a63-9aa4-b739b51a0e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:06.809624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a63c3-4af8-4a63-9aa4-b739b51a0e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:06.819821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a63c3-4af8-4a63-9aa4-b739b51a0e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:06.821245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a63c3-4af8-4a63-9aa4-b739b51a0e2e None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-c82a63c3-4af8-4a63-9aa4-b739b51a0e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 07 14:12:06.838281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:06.839322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:06.840293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 07 14:12:06.840293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 07 14:12:06.840293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 07 14:12:06.840293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:12:06.840293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 621/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:06.844981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4917a-3600-49ab-bdd4-4d1c2be1bccc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:06.940371 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4917a-3600-49ab-bdd4-4d1c2be1bccc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:06.973444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5ab95-0ca0-4649-ac2f-5a1ccd22ebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:06.974096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5ab95-0ca0-4649-ac2f-5a1ccd22ebcd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:06.974381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5ab95-0ca0-4649-ac2f-5a1ccd22ebcd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:06.974656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5ab95-0ca0-4649-ac2f-5a1ccd22ebcd None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:06.975414 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5ab95-0ca0-4649-ac2f-5a1ccd22ebcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:06.975720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5ab95-0ca0-4649-ac2f-5a1ccd22ebcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:06.977091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5ab95-0ca0-4649-ac2f-5a1ccd22ebcd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:06.988532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 663/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jun 7 14:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:06.993939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a63c3-4af8-4a63-9aa4-b739b51a0e2e None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:07.090649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a63c3-4af8-4a63-9aa4-b739b51a0e2e None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:07.104774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:07.125119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7225d-f4d2-41b7-b585-17e466f411bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:07.125897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7225d-f4d2-41b7-b585-17e466f411bf None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:07.126181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7225d-f4d2-41b7-b585-17e466f411bf None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:07.126483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7225d-f4d2-41b7-b585-17e466f411bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:07.132990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7225d-f4d2-41b7-b585-17e466f411bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:07.134422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7225d-f4d2-41b7-b585-17e466f411bf None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application [None req-afd7225d-f4d2-41b7-b585-17e466f411bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 07 14:12:07.147868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:07.148900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:07.150159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 07 14:12:07.150159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 07 14:12:07.150159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 07 14:12:07.150159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 07 14:12:07.150159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 07 14:12:07.150159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 07 14:12:07.150159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 07 14:12:07.150159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: ERROR keystone.server.flask.application Jun 07 14:12:07.150159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 622/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jun 7 14:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:07.154584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5ab95-0ca0-4649-ac2f-5a1ccd22ebcd None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:07.204372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:07.253821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5ab95-0ca0-4649-ac2f-5a1ccd22ebcd None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:07.290876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fd6a2-68c3-492b-8873-eebc603efd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:07.291557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fd6a2-68c3-492b-8873-eebc603efd0f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:07.291852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fd6a2-68c3-492b-8873-eebc603efd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:07.292128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fd6a2-68c3-492b-8873-eebc603efd0f None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:07.292920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fd6a2-68c3-492b-8873-eebc603efd0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:07.293228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fd6a2-68c3-492b-8873-eebc603efd0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:07.294661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812fd6a2-68c3-492b-8873-eebc603efd0f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:07.306483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 664/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jun 7 14:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:07.312485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7225d-f4d2-41b7-b585-17e466f411bf None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:07.411496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7225d-f4d2-41b7-b585-17e466f411bf None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:07.444314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c0915-1361-4883-879d-ae30045b7fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:07.444947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c0915-1361-4883-879d-ae30045b7fbb None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:07.445229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c0915-1361-4883-879d-ae30045b7fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:07.445500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c0915-1361-4883-879d-ae30045b7fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:07.446320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c0915-1361-4883-879d-ae30045b7fbb None admin] RBAC: Adding query filter params (role.id=c6577847f998435991dac5744a94d0ee, scope.project.id=3993f115eb5d49abac749d934f3ec449, user.id=a0cc577feba04e66b950a69b918d4ea1) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:07.446626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c0915-1361-4883-879d-ae30045b7fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:07.448056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c0915-1361-4883-879d-ae30045b7fbb None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:07.453979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 623/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jun 7 14:12:07 2022] GET /identity/v3/role_assignments?user.id=a0cc577feba04e66b950a69b918d4ea1&scope.project.id=3993f115eb5d49abac749d934f3ec449&role.id=c6577847f998435991dac5744a94d0ee => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:09.668924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d742f-3f20-42ce-bd9b-3b4cc07572a9 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:09.669440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d742f-3f20-42ce-bd9b-3b4cc07572a9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:09.669550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d742f-3f20-42ce-bd9b-3b4cc07572a9 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:09.670824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 665/1288] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:12:09.676471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b299b29-bde6-4f43-9a78-1725accad64a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:09.676875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b299b29-bde6-4f43-9a78-1725accad64a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:09.677026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b299b29-bde6-4f43-9a78-1725accad64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:09.694049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6b299b29-bde6-4f43-9a78-1725accad64a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:12:09.695234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6b299b29-bde6-4f43-9a78-1725accad64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:12:09.724304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:09.761304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 624/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:12:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:12:09.782833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d742f-3f20-42ce-bd9b-3b4cc07572a9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:09.881504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d742f-3f20-42ce-bd9b-3b4cc07572a9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:09.891808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:09.914982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c555c-f0e3-46a5-b500-ebf3152f4ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:09.915804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c555c-f0e3-46a5-b500-ebf3152f4ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:09.916088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c555c-f0e3-46a5-b500-ebf3152f4ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:09.916363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c555c-f0e3-46a5-b500-ebf3152f4ff8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:09.917012 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c555c-f0e3-46a5-b500-ebf3152f4ff8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:09.918356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c555c-f0e3-46a5-b500-ebf3152f4ff8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-673c555c-f0e3-46a5-b500-ebf3152f4ff8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:09.930473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:09.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:09.933000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 666/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:12:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:09.937599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b299b29-bde6-4f43-9a78-1725accad64a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:10.033541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b299b29-bde6-4f43-9a78-1725accad64a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:10.066300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113afb1-0e96-4e6e-93a8-abf23f102c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:10.066958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113afb1-0e96-4e6e-93a8-abf23f102c9d None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:10.067245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113afb1-0e96-4e6e-93a8-abf23f102c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:10.067555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113afb1-0e96-4e6e-93a8-abf23f102c9d None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:10.068264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113afb1-0e96-4e6e-93a8-abf23f102c9d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:10.068572 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113afb1-0e96-4e6e-93a8-abf23f102c9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:10.069925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113afb1-0e96-4e6e-93a8-abf23f102c9d None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:10.074642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 625/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Jun 7 14:12:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:10.080464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c555c-f0e3-46a5-b500-ebf3152f4ff8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:10.176058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c555c-f0e3-46a5-b500-ebf3152f4ff8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:10.207607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821062f-f0a8-43a1-a601-37dc3f1d2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:10.208254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821062f-f0a8-43a1-a601-37dc3f1d2e16 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:10.208536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821062f-f0a8-43a1-a601-37dc3f1d2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:10.208817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821062f-f0a8-43a1-a601-37dc3f1d2e16 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:10.209517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821062f-f0a8-43a1-a601-37dc3f1d2e16 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:10.209820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821062f-f0a8-43a1-a601-37dc3f1d2e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:10.211165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821062f-f0a8-43a1-a601-37dc3f1d2e16 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:10.215545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 667/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Jun 7 14:12:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:12:12.421676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16106a63-bd12-4002-8b52-cf6064f77c02 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:12.422249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16106a63-bd12-4002-8b52-cf6064f77c02 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:12.422249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16106a63-bd12-4002-8b52-cf6064f77c02 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:12.423635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 626/1293] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:12:12.428741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec815625-a627-49f4-a754-2366dc3e687a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:12.429146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec815625-a627-49f4-a754-2366dc3e687a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:12.429305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec815625-a627-49f4-a754-2366dc3e687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:12.447229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ec815625-a627-49f4-a754-2366dc3e687a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:12:12.448453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ec815625-a627-49f4-a754-2366dc3e687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:12:12.477818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:12.515053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 668/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:12:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:12:12.537784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16106a63-bd12-4002-8b52-cf6064f77c02 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:12.569088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:12.638446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16106a63-bd12-4002-8b52-cf6064f77c02 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:12.671399 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030f6d3-cd8f-40c3-8109-d8d488325408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:12.672107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030f6d3-cd8f-40c3-8109-d8d488325408 None admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:12.672343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030f6d3-cd8f-40c3-8109-d8d488325408 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:12.672627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030f6d3-cd8f-40c3-8109-d8d488325408 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:12.673872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030f6d3-cd8f-40c3-8109-d8d488325408 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:12.675225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030f6d3-cd8f-40c3-8109-d8d488325408 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:12.687881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 627/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jun 7 14:12:12 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:12:14.900721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6482ec4-e83f-44c0-81a0-6d37982e4a21 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:14.901250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6482ec4-e83f-44c0-81a0-6d37982e4a21 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:14.901355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6482ec4-e83f-44c0-81a0-6d37982e4a21 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:14.902678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 669/1296] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:12:14.907905 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477b95-23fc-401f-82a7-335be4bed1de None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:14.908330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477b95-23fc-401f-82a7-335be4bed1de None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:14.908460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477b95-23fc-401f-82a7-335be4bed1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:14.925372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-41477b95-23fc-401f-82a7-335be4bed1de None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:12:14.926547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-41477b95-23fc-401f-82a7-335be4bed1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:12:14.996514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 628/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:12:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:12:15.019288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6482ec4-e83f-44c0-81a0-6d37982e4a21 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:15.117683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6482ec4-e83f-44c0-81a0-6d37982e4a21 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:15.150326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b802c2d-6f92-4121-810f-17ea94317a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:15.151150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b802c2d-6f92-4121-810f-17ea94317a50 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:15.151415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b802c2d-6f92-4121-810f-17ea94317a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:15.151692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b802c2d-6f92-4121-810f-17ea94317a50 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:15.152339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b802c2d-6f92-4121-810f-17ea94317a50 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:15.153685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b802c2d-6f92-4121-810f-17ea94317a50 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-9b802c2d-6f92-4121-810f-17ea94317a50 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:15.165729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:15.166898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:15.168137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 670/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:12:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:15.172708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477b95-23fc-401f-82a7-335be4bed1de None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:15.190937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:15.270801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477b95-23fc-401f-82a7-335be4bed1de None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:15.304358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c78186-fece-4611-84a8-31e93c534c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:15.305026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c78186-fece-4611-84a8-31e93c534c72 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:15.305313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c78186-fece-4611-84a8-31e93c534c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:15.305593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c78186-fece-4611-84a8-31e93c534c72 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:15.306359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c78186-fece-4611-84a8-31e93c534c72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:15.306667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c78186-fece-4611-84a8-31e93c534c72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:15.308088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c78186-fece-4611-84a8-31e93c534c72 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:15.313135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 629/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Jun 7 14:12:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:15.318986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b802c2d-6f92-4121-810f-17ea94317a50 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:15.350208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:15.417095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b802c2d-6f92-4121-810f-17ea94317a50 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:15.449242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1729ea0-257d-47a2-9a8d-c89fda8653ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:15.449883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1729ea0-257d-47a2-9a8d-c89fda8653ca None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:15.450169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1729ea0-257d-47a2-9a8d-c89fda8653ca None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:15.450448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1729ea0-257d-47a2-9a8d-c89fda8653ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:15.451233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1729ea0-257d-47a2-9a8d-c89fda8653ca None admin] RBAC: Adding query filter params (interface=public, service_id=ea03197f6fcc4152b3432adbfac56121, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:15.451578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1729ea0-257d-47a2-9a8d-c89fda8653ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:15.453189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1729ea0-257d-47a2-9a8d-c89fda8653ca None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:15.458254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 671/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jun 7 14:12:15 2022] GET /identity/v3/endpoints?service_id=ea03197f6fcc4152b3432adbfac56121&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:12:15.463706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c78186-fece-4611-84a8-31e93c534c72 None admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:15.544648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:15.562274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c78186-fece-4611-84a8-31e93c534c72 None admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:15.595135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2090f-ab9a-41ac-a2eb-a40d5ca89000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:15.595813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2090f-ab9a-41ac-a2eb-a40d5ca89000 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:15.596096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2090f-ab9a-41ac-a2eb-a40d5ca89000 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:15.596370 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2090f-ab9a-41ac-a2eb-a40d5ca89000 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:15.597049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2090f-ab9a-41ac-a2eb-a40d5ca89000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:15.598416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2090f-ab9a-41ac-a2eb-a40d5ca89000 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:15.605062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 630/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jun 7 14:12:15 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:12:17.825422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652eb5d-ec55-4726-a95b-df7ece376f1c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:17.825924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652eb5d-ec55-4726-a95b-df7ece376f1c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:17.825924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652eb5d-ec55-4726-a95b-df7ece376f1c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:17.827242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 672/1302] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:12:17.833102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039d7bd-b2df-4c3e-b667-7a99f8d0117f None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:17.833485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039d7bd-b2df-4c3e-b667-7a99f8d0117f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:17.833665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039d7bd-b2df-4c3e-b667-7a99f8d0117f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:17.850546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b039d7bd-b2df-4c3e-b667-7a99f8d0117f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:12:17.851757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b039d7bd-b2df-4c3e-b667-7a99f8d0117f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:12:17.916278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 631/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:12:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 07 14:12:17.938452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652eb5d-ec55-4726-a95b-df7ece376f1c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:18.030651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:18.037798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652eb5d-ec55-4726-a95b-df7ece376f1c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:18.069510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00110f2f-93fb-4527-a25a-6a363500ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:18.070298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110f2f-93fb-4527-a25a-6a363500ae5f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:18.070582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110f2f-93fb-4527-a25a-6a363500ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:18.070856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00110f2f-93fb-4527-a25a-6a363500ae5f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:18.071526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00110f2f-93fb-4527-a25a-6a363500ae5f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:18.072869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00110f2f-93fb-4527-a25a-6a363500ae5f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-00110f2f-93fb-4527-a25a-6a363500ae5f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 07 14:12:18.085334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 07 14:12:18.086545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 07 14:12:18.087646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 673/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jun 7 14:12:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 07 14:12:18.092319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039d7bd-b2df-4c3e-b667-7a99f8d0117f None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:18.166173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:18.188846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039d7bd-b2df-4c3e-b667-7a99f8d0117f None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:18.221721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ccf5a-6ecc-4f85-bab6-7b75052bb7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:18.222372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ccf5a-6ecc-4f85-bab6-7b75052bb7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:18.222657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ccf5a-6ecc-4f85-bab6-7b75052bb7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:18.222933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ccf5a-6ecc-4f85-bab6-7b75052bb7b2 None admin] PATH_INFO: `/v3/services` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:18.223685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ccf5a-6ecc-4f85-bab6-7b75052bb7b2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:12:18.223999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ccf5a-6ecc-4f85-bab6-7b75052bb7b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:18.225347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ccf5a-6ecc-4f85-bab6-7b75052bb7b2 None admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:18.230328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 632/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Jun 7 14:12:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:12:18.235789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00110f2f-93fb-4527-a25a-6a363500ae5f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:12:18.331178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00110f2f-93fb-4527-a25a-6a363500ae5f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:12:18.362515 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905783a3-6db0-43f8-9773-ba02b977600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:12:18.363095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905783a3-6db0-43f8-9773-ba02b977600c None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:12:18.363394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905783a3-6db0-43f8-9773-ba02b977600c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:12:18.363669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905783a3-6db0-43f8-9773-ba02b977600c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:12:18.364400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905783a3-6db0-43f8-9773-ba02b977600c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:12:18.365742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905783a3-6db0-43f8-9773-ba02b977600c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:12:18.383306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 674/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jun 7 14:12:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:12:28.227371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=30 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:12:28.379120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:21.656622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e5eff-74aa-4a16-89a4-17578dc7350c None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:21.657148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e5eff-74aa-4a16-89a4-17578dc7350c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:21.657148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e5eff-74aa-4a16-89a4-17578dc7350c None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:21.658963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 633/1307] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:21.663956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b45c59-0748-4f14-a5af-b13886a98990 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:21.664393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b45c59-0748-4f14-a5af-b13886a98990 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:21.664904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b45c59-0748-4f14-a5af-b13886a98990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:21.788153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-42b45c59-0748-4f14-a5af-b13886a98990 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:21.789349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-42b45c59-0748-4f14-a5af-b13886a98990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:21.904829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 675/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:21.960002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0404-e56f-4eb0-a4c7-3b2ac16a74ac None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:21.960311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0404-e56f-4eb0-a4c7-3b2ac16a74ac None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:21.960718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0404-e56f-4eb0-a4c7-3b2ac16a74ac None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:21.963050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 634/1309] 10.222.0.77 () {54 vars in 964 bytes} [Tue Jun 7 14:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:21.971565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573975e-a1e9-4245-94fe-921566776832 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:21.972184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573975e-a1e9-4245-94fe-921566776832 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:21.972586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573975e-a1e9-4245-94fe-921566776832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:22.196923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c573975e-a1e9-4245-94fe-921566776832 None None] MFA Rules not processed for user `fafd295a115c4f5d912e49d6a21d67b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:22.198147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c573975e-a1e9-4245-94fe-921566776832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:22.220687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:22.287501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 676/1310] 10.222.0.77 () {58 vars in 1061 bytes} [Tue Jun 7 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:22.292835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb0404-e56f-4eb0-a4c7-3b2ac16a74ac None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:22.295038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3dcb0404-e56f-4eb0-a4c7-3b2ac16a74ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:22.412575 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb0404-e56f-4eb0-a4c7-3b2ac16a74ac None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:22.499119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71189dd7-d7cf-4fcb-ba83-f640e26d2586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:22.499963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71189dd7-d7cf-4fcb-ba83-f640e26d2586 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:22.500254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71189dd7-d7cf-4fcb-ba83-f640e26d2586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:22.500534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71189dd7-d7cf-4fcb-ba83-f640e26d2586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:22.502360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-71189dd7-d7cf-4fcb-ba83-f640e26d2586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:22.561692 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:22.629061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71189dd7-d7cf-4fcb-ba83-f640e26d2586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:22.630543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71189dd7-d7cf-4fcb-ba83-f640e26d2586 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:22.653059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 635/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:25.186003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369248a3-fcf9-4b26-aa4f-24540335298d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:25.186444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369248a3-fcf9-4b26-aa4f-24540335298d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:25.186546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369248a3-fcf9-4b26-aa4f-24540335298d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:25.192004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 677/1312] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:25.193423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca403-3d1e-4ebc-9b42-82fab4c03412 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:25.193836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca403-3d1e-4ebc-9b42-82fab4c03412 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:25.193988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca403-3d1e-4ebc-9b42-82fab4c03412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:25.270671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-78fca403-3d1e-4ebc-9b42-82fab4c03412 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:25.272222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-78fca403-3d1e-4ebc-9b42-82fab4c03412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:25.374495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 636/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:13:25.412300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369248a3-fcf9-4b26-aa4f-24540335298d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:25.413941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-369248a3-fcf9-4b26-aa4f-24540335298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:25.527159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369248a3-fcf9-4b26-aa4f-24540335298d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:25.602376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:25.605760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b8949-1025-450a-aa58-af63fd2993bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:25.606992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b8949-1025-450a-aa58-af63fd2993bc service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:25.607277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b8949-1025-450a-aa58-af63fd2993bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:25.607967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b8949-1025-450a-aa58-af63fd2993bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:25.610280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6b4b8949-1025-450a-aa58-af63fd2993bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:25.724316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b8949-1025-450a-aa58-af63fd2993bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:25.725650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b8949-1025-450a-aa58-af63fd2993bc service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:25.744692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 678/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:28.301526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84048773-aeb3-49bc-8572-67d0286daff0 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:28.302070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84048773-aeb3-49bc-8572-67d0286daff0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:28.302070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84048773-aeb3-49bc-8572-67d0286daff0 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:28.303391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 637/1315] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:28.308495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db695f-68ba-408f-b8a0-6c14e3ddf342 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:28.308916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db695f-68ba-408f-b8a0-6c14e3ddf342 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:28.309055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db695f-68ba-408f-b8a0-6c14e3ddf342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:28.374527 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-40db695f-68ba-408f-b8a0-6c14e3ddf342 None None] MFA Rules not processed for user `dc32afaae6ca4f2aa28cb24fd65dc652`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:28.375834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-40db695f-68ba-408f-b8a0-6c14e3ddf342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:28.427929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:28.473063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 679/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:28.511774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84048773-aeb3-49bc-8572-67d0286daff0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:28.513829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-84048773-aeb3-49bc-8572-67d0286daff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:28.523644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:28.624490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84048773-aeb3-49bc-8572-67d0286daff0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:28.706195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb20d42-bffd-4656-85eb-c1964edc73cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:28.706868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20d42-bffd-4656-85eb-c1964edc73cd service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:28.707154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20d42-bffd-4656-85eb-c1964edc73cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:28.707472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb20d42-bffd-4656-85eb-c1964edc73cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:28.709275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-bfb20d42-bffd-4656-85eb-c1964edc73cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:28.779170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:28.825016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb20d42-bffd-4656-85eb-c1964edc73cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:28.827235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb20d42-bffd-4656-85eb-c1964edc73cd service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:28.847155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 638/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:31.647544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f49d-06de-42c3-af58-165936b1af8b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:31.648104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f49d-06de-42c3-af58-165936b1af8b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:31.648104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f49d-06de-42c3-af58-165936b1af8b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:31.649486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 680/1318] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:31.655241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddc42d-d351-47bb-adaf-10075df89d7b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:31.655683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddc42d-d351-47bb-adaf-10075df89d7b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:31.655855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddc42d-d351-47bb-adaf-10075df89d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:31.719450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-13ddc42d-d351-47bb-adaf-10075df89d7b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:31.720666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-13ddc42d-d351-47bb-adaf-10075df89d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:31.814550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 639/1319] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:31.865969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed4445-b6c6-4d33-ad24-0a59cf93354b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:31.866262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed4445-b6c6-4d33-ad24-0a59cf93354b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:31.866544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed4445-b6c6-4d33-ad24-0a59cf93354b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:31.867960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 681/1320] 10.222.0.77 () {54 vars in 964 bytes} [Tue Jun 7 14:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:31.873989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22470747-4cbe-48f6-b95c-8eca5fecab7f None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:31.874282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22470747-4cbe-48f6-b95c-8eca5fecab7f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:31.874562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22470747-4cbe-48f6-b95c-8eca5fecab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:31.895398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:31.948931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-22470747-4cbe-48f6-b95c-8eca5fecab7f None None] MFA Rules not processed for user `fafd295a115c4f5d912e49d6a21d67b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:31.950763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-22470747-4cbe-48f6-b95c-8eca5fecab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:32.025344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 640/1321] 10.222.0.77 () {58 vars in 1061 bytes} [Tue Jun 7 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:32.034440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed4445-b6c6-4d33-ad24-0a59cf93354b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:32.035935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b0ed4445-b6c6-4d33-ad24-0a59cf93354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:32.136937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed4445-b6c6-4d33-ad24-0a59cf93354b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:32.208083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a482480-0474-49c4-a56a-e58248a95e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:32.208719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482480-0474-49c4-a56a-e58248a95e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:32.209002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482480-0474-49c4-a56a-e58248a95e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:32.209278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a482480-0474-49c4-a56a-e58248a95e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:32.210909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7a482480-0474-49c4-a56a-e58248a95e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:32.218125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:32.318541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a482480-0474-49c4-a56a-e58248a95e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:32.319925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a482480-0474-49c4-a56a-e58248a95e32 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:32.337645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 682/1322] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:35.635752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af837ce-6704-494d-84c4-43ffb321dabf None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:35.636320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af837ce-6704-494d-84c4-43ffb321dabf None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:35.636320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af837ce-6704-494d-84c4-43ffb321dabf None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:35.638287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 641/1323] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:35.643648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c372a1-1da4-44c9-b172-e48511f5e827 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:35.644057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c372a1-1da4-44c9-b172-e48511f5e827 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:35.644213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c372a1-1da4-44c9-b172-e48511f5e827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:35.708266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c6c372a1-1da4-44c9-b172-e48511f5e827 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:35.709459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c6c372a1-1da4-44c9-b172-e48511f5e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:35.768335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:35.808157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 683/1324] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:35.843883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af837ce-6704-494d-84c4-43ffb321dabf None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:35.845442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7af837ce-6704-494d-84c4-43ffb321dabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:35.948603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af837ce-6704-494d-84c4-43ffb321dabf None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:35.960948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:36.022290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a594c31-d689-47ee-8895-2000c8f5ea2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:36.022854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594c31-d689-47ee-8895-2000c8f5ea2c service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:36.023154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594c31-d689-47ee-8895-2000c8f5ea2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:36.023437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594c31-d689-47ee-8895-2000c8f5ea2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:36.025082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2a594c31-d689-47ee-8895-2000c8f5ea2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:36.136562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a594c31-d689-47ee-8895-2000c8f5ea2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:36.138536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a594c31-d689-47ee-8895-2000c8f5ea2c service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:36.156941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 642/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:38.426573 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738f3c5-2cb4-44b7-b8ce-b632e55c032f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:38.427204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738f3c5-2cb4-44b7-b8ce-b632e55c032f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:38.427741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738f3c5-2cb4-44b7-b8ce-b632e55c032f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:38.429115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 684/1326] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:38.435060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d202512-938d-49bb-9454-7b629a597945 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:38.435609 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d202512-938d-49bb-9454-7b629a597945 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:38.435774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d202512-938d-49bb-9454-7b629a597945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:38.482671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:38.502759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8d202512-938d-49bb-9454-7b629a597945 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:38.503986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8d202512-938d-49bb-9454-7b629a597945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:38.601323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 643/1327] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:38.636519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738f3c5-2cb4-44b7-b8ce-b632e55c032f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:38.638654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2738f3c5-2cb4-44b7-b8ce-b632e55c032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:38.739562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738f3c5-2cb4-44b7-b8ce-b632e55c032f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:38.812870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fd4fc-cf93-4b6c-9c46-c25155a5179b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:38.813516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd4fc-cf93-4b6c-9c46-c25155a5179b service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:38.813795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd4fc-cf93-4b6c-9c46-c25155a5179b service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:38.814069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fd4fc-cf93-4b6c-9c46-c25155a5179b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:38.815730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2a2fd4fc-cf93-4b6c-9c46-c25155a5179b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:38.832077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:38.921480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fd4fc-cf93-4b6c-9c46-c25155a5179b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:38.922884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fd4fc-cf93-4b6c-9c46-c25155a5179b service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:38.940800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 685/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:41.235662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561e33c-5423-42ec-9cc9-c04484bb2654 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:41.236168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561e33c-5423-42ec-9cc9-c04484bb2654 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:41.236168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561e33c-5423-42ec-9cc9-c04484bb2654 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:41.237512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 644/1329] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:41.242654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5d9b-f510-4360-8bef-a45285a4f21a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:41.243060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5d9b-f510-4360-8bef-a45285a4f21a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:41.243213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb5d9b-f510-4360-8bef-a45285a4f21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:41.309239 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b0cb5d9b-f510-4360-8bef-a45285a4f21a None None] MFA Rules not processed for user `dc32afaae6ca4f2aa28cb24fd65dc652`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:41.310486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b0cb5d9b-f510-4360-8bef-a45285a4f21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:41.374980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:41.409372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 686/1330] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:41.447103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561e33c-5423-42ec-9cc9-c04484bb2654 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:41.448690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5561e33c-5423-42ec-9cc9-c04484bb2654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:41.552732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561e33c-5423-42ec-9cc9-c04484bb2654 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:41.573436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:41.629675 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7c566-e155-40c9-ac3f-434527a1f849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:41.630335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7c566-e155-40c9-ac3f-434527a1f849 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:41.630616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7c566-e155-40c9-ac3f-434527a1f849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:41.630884 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7c566-e155-40c9-ac3f-434527a1f849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:41.632881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e9f7c566-e155-40c9-ac3f-434527a1f849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:41.742710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7c566-e155-40c9-ac3f-434527a1f849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:41.744288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7c566-e155-40c9-ac3f-434527a1f849 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:41.891394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 645/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:44.358709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83267881-783a-448d-9048-90e03ec4de3f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:44.359245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83267881-783a-448d-9048-90e03ec4de3f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:44.359245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83267881-783a-448d-9048-90e03ec4de3f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:44.360759 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 687/1332] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:44.365982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd306d2f-a386-400d-93e8-cbfdf296d99e None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:44.366408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd306d2f-a386-400d-93e8-cbfdf296d99e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:44.366670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd306d2f-a386-400d-93e8-cbfdf296d99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:44.439613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:44.442468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-fd306d2f-a386-400d-93e8-cbfdf296d99e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:44.444282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-fd306d2f-a386-400d-93e8-cbfdf296d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:44.555234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 646/1333] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:44.590953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83267881-783a-448d-9048-90e03ec4de3f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:44.592589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-83267881-783a-448d-9048-90e03ec4de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:44.696611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83267881-783a-448d-9048-90e03ec4de3f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:44.769207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc505-fe59-43d7-8dd5-53001938d4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:44.769867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc505-fe59-43d7-8dd5-53001938d4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:44.770148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc505-fe59-43d7-8dd5-53001938d4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:44.770423 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc505-fe59-43d7-8dd5-53001938d4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:44.772128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a71fc505-fe59-43d7-8dd5-53001938d4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:44.800708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:44.881811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc505-fe59-43d7-8dd5-53001938d4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:44.883229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc505-fe59-43d7-8dd5-53001938d4c1 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:44.901457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 688/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:47.187061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d5845-eceb-4e66-8cb7-ac514e898cf3 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:47.187646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d5845-eceb-4e66-8cb7-ac514e898cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:47.187646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d5845-eceb-4e66-8cb7-ac514e898cf3 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:47.189062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 647/1335] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:47.194339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eebe1a-029a-40bc-baa9-454875f25b0f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:47.194752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eebe1a-029a-40bc-baa9-454875f25b0f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:47.194903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eebe1a-029a-40bc-baa9-454875f25b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:47.258643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c0eebe1a-029a-40bc-baa9-454875f25b0f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:47.259871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c0eebe1a-029a-40bc-baa9-454875f25b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:47.332413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:47.354509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 689/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:47.394659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d5845-eceb-4e66-8cb7-ac514e898cf3 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:47.396218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f00d5845-eceb-4e66-8cb7-ac514e898cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:47.498200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d5845-eceb-4e66-8cb7-ac514e898cf3 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:47.526054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:47.571079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141a13c-4739-4cf2-a68f-d6ecab5003b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:47.571754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141a13c-4739-4cf2-a68f-d6ecab5003b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:47.572037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141a13c-4739-4cf2-a68f-d6ecab5003b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:47.572308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141a13c-4739-4cf2-a68f-d6ecab5003b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:47.573948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9141a13c-4739-4cf2-a68f-d6ecab5003b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:47.682430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141a13c-4739-4cf2-a68f-d6ecab5003b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:47.683918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141a13c-4739-4cf2-a68f-d6ecab5003b9 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:47.701607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 648/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:50.341412 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52f11b-e4bc-4e97-9235-0e9a979f0006 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:50.341951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52f11b-e4bc-4e97-9235-0e9a979f0006 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:50.341951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52f11b-e4bc-4e97-9235-0e9a979f0006 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:50.343376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 690/1338] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:50.348580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4852-be73-4662-b774-dacce6a65a33 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:50.349000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4852-be73-4662-b774-dacce6a65a33 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:50.349146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4852-be73-4662-b774-dacce6a65a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:50.413334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d0de4852-be73-4662-b774-dacce6a65a33 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:50.414532 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d0de4852-be73-4662-b774-dacce6a65a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:50.423233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:50.511492 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 649/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:50.548214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52f11b-e4bc-4e97-9235-0e9a979f0006 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:50.549738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ee52f11b-e4bc-4e97-9235-0e9a979f0006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:50.649492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52f11b-e4bc-4e97-9235-0e9a979f0006 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:50.721735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b577-0a29-4ef4-993b-8aa3bf6043f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:50.722377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b577-0a29-4ef4-993b-8aa3bf6043f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:50.722661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b577-0a29-4ef4-993b-8aa3bf6043f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:50.722935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b577-0a29-4ef4-993b-8aa3bf6043f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:50.724593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a945b577-0a29-4ef4-993b-8aa3bf6043f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:50.759564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:50.831992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b577-0a29-4ef4-993b-8aa3bf6043f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:50.834209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b577-0a29-4ef4-993b-8aa3bf6043f5 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:50.854289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 691/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:55.035481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d3533-18ea-4108-ac2d-31151b1aeca3 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:55.036045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d3533-18ea-4108-ac2d-31151b1aeca3 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:55.036045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d3533-18ea-4108-ac2d-31151b1aeca3 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:55.037331 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 650/1341] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:55.043165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c8f77-5772-4de8-a5ce-61916614781d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:55.043591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c8f77-5772-4de8-a5ce-61916614781d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:55.043756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c8f77-5772-4de8-a5ce-61916614781d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:55.116832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fb9c8f77-5772-4de8-a5ce-61916614781d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:55.117952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fb9c8f77-5772-4de8-a5ce-61916614781d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:55.209625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:55.223065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 692/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:55.262306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d3533-18ea-4108-ac2d-31151b1aeca3 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:55.264516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-413d3533-18ea-4108-ac2d-31151b1aeca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:55.363405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d3533-18ea-4108-ac2d-31151b1aeca3 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:55.367056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d515be7-bb60-45e4-92e2-7c1b3fb066eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:55.367679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d515be7-bb60-45e4-92e2-7c1b3fb066eb service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:55.367967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d515be7-bb60-45e4-92e2-7c1b3fb066eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:55.368351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d515be7-bb60-45e4-92e2-7c1b3fb066eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:55.378141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d515be7-bb60-45e4-92e2-7c1b3fb066eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:55.379613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d515be7-bb60-45e4-92e2-7c1b3fb066eb service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:55.389152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 651/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:13:58.369579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd11457-2498-41ac-8a84-4bb96bd659da None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:58.370133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd11457-2498-41ac-8a84-4bb96bd659da None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:58.370133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd11457-2498-41ac-8a84-4bb96bd659da None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:58.371489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 693/1344] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:13:58.376755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6de1e-354a-415d-b0da-0938997c86fa None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:58.377235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6de1e-354a-415d-b0da-0938997c86fa None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:58.377442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6de1e-354a-415d-b0da-0938997c86fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:58.405614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-00b6de1e-354a-415d-b0da-0938997c86fa None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:13:58.406805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-00b6de1e-354a-415d-b0da-0938997c86fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:58.433948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:13:58.487358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 652/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:13:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:13:58.524466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd11457-2498-41ac-8a84-4bb96bd659da None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:13:58.526839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9cd11457-2498-41ac-8a84-4bb96bd659da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:13:58.539877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd11457-2498-41ac-8a84-4bb96bd659da None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:13:58.543416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe76c0-bdc5-4fe6-8718-5923e9198472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:13:58.544095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe76c0-bdc5-4fe6-8718-5923e9198472 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:13:58.544380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe76c0-bdc5-4fe6-8718-5923e9198472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:13:58.544659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe76c0-bdc5-4fe6-8718-5923e9198472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:13:58.553525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe76c0-bdc5-4fe6-8718-5923e9198472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:13:58.554941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe76c0-bdc5-4fe6-8718-5923e9198472 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:13:58.564463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 694/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:14:02.689722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42517eeb-99da-41ed-a180-8feeee787c8d None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:02.690295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42517eeb-99da-41ed-a180-8feeee787c8d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:02.690295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42517eeb-99da-41ed-a180-8feeee787c8d None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:02.691707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 653/1347] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:02.697165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f922ef-471d-4b4d-b270-ddd33f28813a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:02.697603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f922ef-471d-4b4d-b270-ddd33f28813a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:02.697779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f922ef-471d-4b4d-b270-ddd33f28813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:02.715984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c0f922ef-471d-4b4d-b270-ddd33f28813a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:02.717160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c0f922ef-471d-4b4d-b270-ddd33f28813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:02.724851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 695/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:02.762734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42517eeb-99da-41ed-a180-8feeee787c8d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:02.773769 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42517eeb-99da-41ed-a180-8feeee787c8d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:02.777886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f03c1-3be0-4fb9-825d-63e0835472c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:02.778588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f03c1-3be0-4fb9-825d-63e0835472c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:02.778877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f03c1-3be0-4fb9-825d-63e0835472c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:02.779152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f03c1-3be0-4fb9-825d-63e0835472c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:02.788190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f03c1-3be0-4fb9-825d-63e0835472c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:02.789609 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f03c1-3be0-4fb9-825d-63e0835472c4 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:02.799093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 654/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:08.239552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c5ee5-3470-462e-890b-7aea4a5a5c15 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:08.240509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c5ee5-3470-462e-890b-7aea4a5a5c15 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:08.241449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c5ee5-3470-462e-890b-7aea4a5a5c15 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:08.243619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 696/1350] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:14:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:08.250364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8bbaf-a8ed-4abb-a535-ce57b66e932d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:08.251383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8bbaf-a8ed-4abb-a535-ce57b66e932d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:08.251894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8bbaf-a8ed-4abb-a535-ce57b66e932d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:08.336431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-cab8bbaf-a8ed-4abb-a535-ce57b66e932d None None] MFA Rules not processed for user `a0cc577feba04e66b950a69b918d4ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:08.340299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-cab8bbaf-a8ed-4abb-a535-ce57b66e932d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:08.481343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 655/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:14:12.498175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bc65c-24f5-45ac-810b-ae09cdd1c9ed None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:12.498619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bc65c-24f5-45ac-810b-ae09cdd1c9ed None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:12.498727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bc65c-24f5-45ac-810b-ae09cdd1c9ed None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:12.500645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 697/1352] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:12.505501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1fb59-b548-4020-b35c-f9c7e312f2ef None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:12.505938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1fb59-b548-4020-b35c-f9c7e312f2ef None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:12.506052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1fb59-b548-4020-b35c-f9c7e312f2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:12.525815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4ac1fb59-b548-4020-b35c-f9c7e312f2ef None None] MFA Rules not processed for user `a0cc577feba04e66b950a69b918d4ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:12.527013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4ac1fb59-b548-4020-b35c-f9c7e312f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:12.536139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 656/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:14:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:12.710265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=13 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:14:14.371291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e994934-3ae9-4344-a6d3-76d2b61141d3 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:14.371944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e994934-3ae9-4344-a6d3-76d2b61141d3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:14.371944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e994934-3ae9-4344-a6d3-76d2b61141d3 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:14.373355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 698/1354] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:14.378297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a25f8-838f-45fd-889d-7d6acd533de2 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:14.378745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a25f8-838f-45fd-889d-7d6acd533de2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:14.378844 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a25f8-838f-45fd-889d-7d6acd533de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:14.396763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-c95a25f8-838f-45fd-889d-7d6acd533de2 None None] MFA Rules not processed for user `a0cc577feba04e66b950a69b918d4ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:14.397946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c95a25f8-838f-45fd-889d-7d6acd533de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:14.406969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 657/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:14:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:18.138198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1144c0-510e-45b2-bfa0-f5bcf4e74a99 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:18.138779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1144c0-510e-45b2-bfa0-f5bcf4e74a99 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:18.138779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1144c0-510e-45b2-bfa0-f5bcf4e74a99 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:18.140135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 699/1356] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:18.145424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1af8-58ba-4d65-b3fd-8d2ec07664c1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:18.145820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1af8-58ba-4d65-b3fd-8d2ec07664c1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:18.145972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1af8-58ba-4d65-b3fd-8d2ec07664c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:18.167789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-ad3f1af8-58ba-4d65-b3fd-8d2ec07664c1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:18.169402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ad3f1af8-58ba-4d65-b3fd-8d2ec07664c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:18.178193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 658/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:18.234001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d78a1-3b0b-4bbe-a6b9-eb9d557f5948 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:18.234588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d78a1-3b0b-4bbe-a6b9-eb9d557f5948 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:18.235081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d78a1-3b0b-4bbe-a6b9-eb9d557f5948 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:18.236826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 700/1358] 10.222.0.77 () {54 vars in 961 bytes} [Tue Jun 7 14:14:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:18.245227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b614d16-f44d-4b03-8572-82bd2d324861 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:18.245523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b614d16-f44d-4b03-8572-82bd2d324861 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:18.245801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b614d16-f44d-4b03-8572-82bd2d324861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:18.296685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:14:18.306624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-2b614d16-f44d-4b03-8572-82bd2d324861 None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:18.308026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2b614d16-f44d-4b03-8572-82bd2d324861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:18.392558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 659/1359] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Jun 7 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:18.401511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d78a1-3b0b-4bbe-a6b9-eb9d557f5948 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:18.417819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d78a1-3b0b-4bbe-a6b9-eb9d557f5948 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:18.423992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cafb4-99f0-4736-8883-3a9e255d7256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:18.424764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cafb4-99f0-4736-8883-3a9e255d7256 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:18.425149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cafb4-99f0-4736-8883-3a9e255d7256 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:18.425529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cafb4-99f0-4736-8883-3a9e255d7256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:18.436033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cafb4-99f0-4736-8883-3a9e255d7256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:18.438158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cafb4-99f0-4736-8883-3a9e255d7256 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:18.451371 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 701/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:20.939127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf863f-287d-47b1-a367-4aa7ead7d283 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:20.939667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf863f-287d-47b1-a367-4aa7ead7d283 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:20.939749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf863f-287d-47b1-a367-4aa7ead7d283 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:20.941262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 660/1361] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:20.946547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9b9cf-3d04-4863-abd4-fb679c97becd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:20.946977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9b9cf-3d04-4863-abd4-fb679c97becd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:20.947105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9b9cf-3d04-4863-abd4-fb679c97becd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:20.965500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7cc9b9cf-3d04-4863-abd4-fb679c97becd None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:20.966684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7cc9b9cf-3d04-4863-abd4-fb679c97becd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:20.974515 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 702/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:21.020082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf863f-287d-47b1-a367-4aa7ead7d283 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:21.034829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf863f-287d-47b1-a367-4aa7ead7d283 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:21.041307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1e846-b6c5-4e3e-9b31-fa1a7e0a75bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:21.041945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1e846-b6c5-4e3e-9b31-fa1a7e0a75bf service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:21.042224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1e846-b6c5-4e3e-9b31-fa1a7e0a75bf service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:21.042494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1e846-b6c5-4e3e-9b31-fa1a7e0a75bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:21.050985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1e846-b6c5-4e3e-9b31-fa1a7e0a75bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:21.052586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1e846-b6c5-4e3e-9b31-fa1a7e0a75bf service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:21.062968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 661/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:23.625558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a93670-835c-4ef3-9edf-a61c25a190ac None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:23.626111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a93670-835c-4ef3-9edf-a61c25a190ac None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:23.626111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a93670-835c-4ef3-9edf-a61c25a190ac None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:23.627547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 703/1364] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:23.632820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb5501-9a3f-449e-b7cf-fda5b008cc65 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:23.633285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb5501-9a3f-449e-b7cf-fda5b008cc65 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:23.633402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb5501-9a3f-449e-b7cf-fda5b008cc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:23.652243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-efbb5501-9a3f-449e-b7cf-fda5b008cc65 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:23.653436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-efbb5501-9a3f-449e-b7cf-fda5b008cc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:23.661990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 662/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:14:23.706556 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c4ab0-e714-4481-8bd9-36e499f56c4a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:23.706847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c4ab0-e714-4481-8bd9-36e499f56c4a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:23.707128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c4ab0-e714-4481-8bd9-36e499f56c4a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:23.708551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 704/1366] 10.222.0.77 () {54 vars in 961 bytes} [Tue Jun 7 14:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:23.714401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add08d23-c96a-495b-9a1f-31215f9f93dd None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:23.714691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add08d23-c96a-495b-9a1f-31215f9f93dd None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:23.714969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add08d23-c96a-495b-9a1f-31215f9f93dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:23.733668 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-add08d23-c96a-495b-9a1f-31215f9f93dd None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:23.734853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-add08d23-c96a-495b-9a1f-31215f9f93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:23.744039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 663/1367] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Jun 7 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:14:23.751508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c4ab0-e714-4481-8bd9-36e499f56c4a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:23.766288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c4ab0-e714-4481-8bd9-36e499f56c4a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:23.772057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecd219-1736-4659-b7a0-10997f2588f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:23.772688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd219-1736-4659-b7a0-10997f2588f3 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:23.772971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd219-1736-4659-b7a0-10997f2588f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:23.773248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecd219-1736-4659-b7a0-10997f2588f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:23.781960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd219-1736-4659-b7a0-10997f2588f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:23.783565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecd219-1736-4659-b7a0-10997f2588f3 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:23.794000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 705/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:26.176135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb357e0e-3fb1-4bfa-8b68-6a092ba53e60 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:26.176727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb357e0e-3fb1-4bfa-8b68-6a092ba53e60 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:26.176727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb357e0e-3fb1-4bfa-8b68-6a092ba53e60 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:26.178054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 664/1369] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:26.183989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767871a-3157-4b54-bf03-845dd3468afe None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:26.184411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767871a-3157-4b54-bf03-845dd3468afe None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:26.184552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767871a-3157-4b54-bf03-845dd3468afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:26.202842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7767871a-3157-4b54-bf03-845dd3468afe None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:26.204075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7767871a-3157-4b54-bf03-845dd3468afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:26.212224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 706/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:26.258308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb357e0e-3fb1-4bfa-8b68-6a092ba53e60 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:26.274276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb357e0e-3fb1-4bfa-8b68-6a092ba53e60 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:26.280175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b432a06-733b-416b-a242-8f67661d4abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:26.280850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b432a06-733b-416b-a242-8f67661d4abf service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:26.281137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b432a06-733b-416b-a242-8f67661d4abf service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:26.281414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b432a06-733b-416b-a242-8f67661d4abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:26.291521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b432a06-733b-416b-a242-8f67661d4abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:26.293142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b432a06-733b-416b-a242-8f67661d4abf service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:26.304349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 665/1371] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:14:26.348097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06961a-b6d1-461d-85a5-1f80010142dd None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:26.348509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06961a-b6d1-461d-85a5-1f80010142dd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:26.349095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06961a-b6d1-461d-85a5-1f80010142dd None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:26.350772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 707/1372] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:26.356828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d730bb-9b32-4b7e-a3e2-cfe2eda54a31 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:26.357119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d730bb-9b32-4b7e-a3e2-cfe2eda54a31 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:26.357398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d730bb-9b32-4b7e-a3e2-cfe2eda54a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:26.379450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-75d730bb-9b32-4b7e-a3e2-cfe2eda54a31 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:26.380821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-75d730bb-9b32-4b7e-a3e2-cfe2eda54a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:26.390030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 666/1373] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:26.696169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602dd10-99b4-423a-abc8-53d008247066 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:26.696408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602dd10-99b4-423a-abc8-53d008247066 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:26.696676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602dd10-99b4-423a-abc8-53d008247066 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:26.698280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 708/1374] 10.222.0.77 () {54 vars in 963 bytes} [Tue Jun 7 14:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:26.703526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b592d-45ee-4d72-a8bf-940242775a32 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:26.703928 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b592d-45ee-4d72-a8bf-940242775a32 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:26.704311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b592d-45ee-4d72-a8bf-940242775a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:26.755092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-898b592d-45ee-4d72-a8bf-940242775a32 None None] MFA Rules not processed for user `dbba49c3d7c24cd699d85fb93c76e7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:26.756259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-898b592d-45ee-4d72-a8bf-940242775a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:26.820791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 667/1375] 10.222.0.77 () {58 vars in 1060 bytes} [Tue Jun 7 14:14:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:26.828367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602dd10-99b4-423a-abc8-53d008247066 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:26.840121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602dd10-99b4-423a-abc8-53d008247066 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:26.843818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc958d2-0ad8-4eb3-894a-937e672dd102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:26.844458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc958d2-0ad8-4eb3-894a-937e672dd102 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:26.844736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc958d2-0ad8-4eb3-894a-937e672dd102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:26.845008 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc958d2-0ad8-4eb3-894a-937e672dd102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:26.855274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc958d2-0ad8-4eb3-894a-937e672dd102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:26.856743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc958d2-0ad8-4eb3-894a-937e672dd102 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:26.867025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 709/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:28.606747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33276305-0609-4b12-8e1b-dcc915836066 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:28.607359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33276305-0609-4b12-8e1b-dcc915836066 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:28.607359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33276305-0609-4b12-8e1b-dcc915836066 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:28.608875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 668/1377] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:28.614996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b514f7-8cb8-401b-af49-4e7f1c49ff76 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:28.615569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b514f7-8cb8-401b-af49-4e7f1c49ff76 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:28.615569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b514f7-8cb8-401b-af49-4e7f1c49ff76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:28.634921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a2b514f7-8cb8-401b-af49-4e7f1c49ff76 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:28.636208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a2b514f7-8cb8-401b-af49-4e7f1c49ff76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:28.644314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 710/1378] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:28.690100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33276305-0609-4b12-8e1b-dcc915836066 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:28.705679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33276305-0609-4b12-8e1b-dcc915836066 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:28.711950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fa997-bd7f-45cc-909f-f92a3dc51084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:28.712628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fa997-bd7f-45cc-909f-f92a3dc51084 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:28.712922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fa997-bd7f-45cc-909f-f92a3dc51084 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:28.713200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fa997-bd7f-45cc-909f-f92a3dc51084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:28.722510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fa997-bd7f-45cc-909f-f92a3dc51084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:28.724168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fa997-bd7f-45cc-909f-f92a3dc51084 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:28.729162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:14:28.736749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 669/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:31.053667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9d41-04e4-4c2f-bdd4-f3f1aaffdd93 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:31.054208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9d41-04e4-4c2f-bdd4-f3f1aaffdd93 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:31.054494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9d41-04e4-4c2f-bdd4-f3f1aaffdd93 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:31.056164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 711/1380] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:31.061426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93c83-fb5a-4a8c-bfa9-62512c471496 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:31.061850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93c83-fb5a-4a8c-bfa9-62512c471496 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:31.062040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93c83-fb5a-4a8c-bfa9-62512c471496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:31.081223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-65f93c83-fb5a-4a8c-bfa9-62512c471496 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:31.082422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-65f93c83-fb5a-4a8c-bfa9-62512c471496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:31.091146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 670/1381] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:31.134757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b9d41-04e4-4c2f-bdd4-f3f1aaffdd93 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:31.150499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b9d41-04e4-4c2f-bdd4-f3f1aaffdd93 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:31.156298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819edf2c-4d03-42c0-a173-7c283334be6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:31.157084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819edf2c-4d03-42c0-a173-7c283334be6f service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:31.157471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819edf2c-4d03-42c0-a173-7c283334be6f service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:31.157849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819edf2c-4d03-42c0-a173-7c283334be6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:31.168081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819edf2c-4d03-42c0-a173-7c283334be6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:31.169770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819edf2c-4d03-42c0-a173-7c283334be6f service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:31.179683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 712/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:33.465760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38fbeb-6f00-41e7-ba11-58fdc485f200 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:33.466679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38fbeb-6f00-41e7-ba11-58fdc485f200 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:33.466961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38fbeb-6f00-41e7-ba11-58fdc485f200 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:33.468525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 671/1383] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:33.473824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dd5b1-f0ac-4cec-8ed0-9f34144da028 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:33.474236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dd5b1-f0ac-4cec-8ed0-9f34144da028 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:33.474440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dd5b1-f0ac-4cec-8ed0-9f34144da028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:33.498162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e14dd5b1-f0ac-4cec-8ed0-9f34144da028 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:33.499394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e14dd5b1-f0ac-4cec-8ed0-9f34144da028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:33.507546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 713/1384] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:33.549966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38fbeb-6f00-41e7-ba11-58fdc485f200 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:33.564951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38fbeb-6f00-41e7-ba11-58fdc485f200 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:33.570962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17903f-df48-44ec-b5d0-a365c2206f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:33.571864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17903f-df48-44ec-b5d0-a365c2206f32 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:33.572149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17903f-df48-44ec-b5d0-a365c2206f32 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:33.572428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17903f-df48-44ec-b5d0-a365c2206f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:33.581396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17903f-df48-44ec-b5d0-a365c2206f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:33.582983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17903f-df48-44ec-b5d0-a365c2206f32 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:33.593581 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 672/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:35.984517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfb28f-ff5f-436b-a300-8553ef612dd1 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:35.985073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfb28f-ff5f-436b-a300-8553ef612dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:35.985073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfb28f-ff5f-436b-a300-8553ef612dd1 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:35.986438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 714/1386] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:35.992950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a3e3-5c68-48df-b9ad-8fbb66ecba42 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:35.993503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a3e3-5c68-48df-b9ad-8fbb66ecba42 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:35.993606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a3e3-5c68-48df-b9ad-8fbb66ecba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:36.012387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8747a3e3-5c68-48df-b9ad-8fbb66ecba42 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:36.013642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8747a3e3-5c68-48df-b9ad-8fbb66ecba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:36.021922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 673/1387] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:36.067401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfb28f-ff5f-436b-a300-8553ef612dd1 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:36.084460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfb28f-ff5f-436b-a300-8553ef612dd1 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:36.092045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39300a-11ab-4959-8632-f820142f58f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:36.092833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39300a-11ab-4959-8632-f820142f58f1 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:36.093433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39300a-11ab-4959-8632-f820142f58f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:36.093785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39300a-11ab-4959-8632-f820142f58f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:36.104600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39300a-11ab-4959-8632-f820142f58f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:36.106449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39300a-11ab-4959-8632-f820142f58f1 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:36.118881 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 715/1388] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:38.502594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2df5ef-5cad-4150-b4b6-802e1444be4c None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:38.503191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2df5ef-5cad-4150-b4b6-802e1444be4c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:38.503191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2df5ef-5cad-4150-b4b6-802e1444be4c None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:38.504630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 674/1389] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:38.510714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c618e8-787e-4c49-b4d2-64b4c5258e2e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:38.511205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c618e8-787e-4c49-b4d2-64b4c5258e2e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:38.511381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c618e8-787e-4c49-b4d2-64b4c5258e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:38.529827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b1c618e8-787e-4c49-b4d2-64b4c5258e2e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:38.531032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b1c618e8-787e-4c49-b4d2-64b4c5258e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:38.539751 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 716/1390] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:38.584502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2df5ef-5cad-4150-b4b6-802e1444be4c None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:38.598769 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2df5ef-5cad-4150-b4b6-802e1444be4c None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:38.604205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4cc2e-891d-455b-a088-f52793afbe7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:38.604839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4cc2e-891d-455b-a088-f52793afbe7c service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:38.605119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4cc2e-891d-455b-a088-f52793afbe7c service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:38.605391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4cc2e-891d-455b-a088-f52793afbe7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:38.614912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4cc2e-891d-455b-a088-f52793afbe7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:38.616529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4cc2e-891d-455b-a088-f52793afbe7c service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:38.627281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 675/1391] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:40.971143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1efc-6f63-419c-b273-c9e6f053df3a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:40.971781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1efc-6f63-419c-b273-c9e6f053df3a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:40.971781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b1efc-6f63-419c-b273-c9e6f053df3a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:40.973086 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 717/1392] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:40.979109 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164463be-fc7d-4f04-9ea7-d833ea97e0f1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:40.979632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164463be-fc7d-4f04-9ea7-d833ea97e0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:40.979728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164463be-fc7d-4f04-9ea7-d833ea97e0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:40.997140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-164463be-fc7d-4f04-9ea7-d833ea97e0f1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:40.998345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-164463be-fc7d-4f04-9ea7-d833ea97e0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:41.006578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 676/1393] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:41.051065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1efc-6f63-419c-b273-c9e6f053df3a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:41.065224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b1efc-6f63-419c-b273-c9e6f053df3a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:41.071026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162dfa5-9fb6-458c-86ec-22a56116069f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:41.071752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162dfa5-9fb6-458c-86ec-22a56116069f service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:41.072123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162dfa5-9fb6-458c-86ec-22a56116069f service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:41.072399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162dfa5-9fb6-458c-86ec-22a56116069f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:41.080814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162dfa5-9fb6-458c-86ec-22a56116069f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:41.082367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162dfa5-9fb6-458c-86ec-22a56116069f service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:41.092391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 718/1394] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:42.757790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f332-7200-481e-8da3-7379da04524e None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:42.758312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f332-7200-481e-8da3-7379da04524e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:42.758312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f332-7200-481e-8da3-7379da04524e None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:42.759705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 677/1395] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:42.765027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049259fe-12f9-4d27-8079-61721104befe None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:42.765451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049259fe-12f9-4d27-8079-61721104befe None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:42.765591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049259fe-12f9-4d27-8079-61721104befe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:42.771592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=52 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:14:42.784742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-049259fe-12f9-4d27-8079-61721104befe None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:42.785935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-049259fe-12f9-4d27-8079-61721104befe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:42.793928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 719/1396] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:42.849260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041238-7eee-445c-92f0-38ab41643aee None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:42.849551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041238-7eee-445c-92f0-38ab41643aee None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:42.849831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07041238-7eee-445c-92f0-38ab41643aee None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:42.851301 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 678/1397] 10.222.0.77 () {54 vars in 962 bytes} [Tue Jun 7 14:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:42.856553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776428f-98cb-41f9-b24b-cc63cbbaed7b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:42.856848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776428f-98cb-41f9-b24b-cc63cbbaed7b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:42.857133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776428f-98cb-41f9-b24b-cc63cbbaed7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:42.905677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5776428f-98cb-41f9-b24b-cc63cbbaed7b None None] MFA Rules not processed for user `a418c5817e784d299c8d6daad20c6cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:42.906879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5776428f-98cb-41f9-b24b-cc63cbbaed7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:42.967561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 720/1398] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Jun 7 14:14:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:42.975246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041238-7eee-445c-92f0-38ab41643aee None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:42.985894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07041238-7eee-445c-92f0-38ab41643aee None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:42.989459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f606e6d-3ba0-45d7-9c2c-3dd5108bd276 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a418c5817e784d299c8d6daad20c6cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:42.990093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f606e6d-3ba0-45d7-9c2c-3dd5108bd276 service glance] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:42.990378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f606e6d-3ba0-45d7-9c2c-3dd5108bd276 service glance] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:42.990654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f606e6d-3ba0-45d7-9c2c-3dd5108bd276 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:43.000560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f606e6d-3ba0-45d7-9c2c-3dd5108bd276 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:43.001983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f606e6d-3ba0-45d7-9c2c-3dd5108bd276 service glance] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:43.012985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 679/1399] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:43.352729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da9a62-8455-47a4-9937-ee57c486e453 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:43.352942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da9a62-8455-47a4-9937-ee57c486e453 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:43.353171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da9a62-8455-47a4-9937-ee57c486e453 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:43.354558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 721/1400] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:43.359846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af472-9d20-4a53-9c91-960ab48a8d2b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:43.360141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af472-9d20-4a53-9c91-960ab48a8d2b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:43.360420 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af472-9d20-4a53-9c91-960ab48a8d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:43.378449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-703af472-9d20-4a53-9c91-960ab48a8d2b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:43.379686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-703af472-9d20-4a53-9c91-960ab48a8d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:43.387520 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 680/1401] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:43.432060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da9a62-8455-47a4-9937-ee57c486e453 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:43.446451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da9a62-8455-47a4-9937-ee57c486e453 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:43.452357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f46265-0961-4bb0-aafa-ae588e8f145a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:43.452999 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f46265-0961-4bb0-aafa-ae588e8f145a service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:43.453282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f46265-0961-4bb0-aafa-ae588e8f145a service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:43.453561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f46265-0961-4bb0-aafa-ae588e8f145a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:43.461900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f46265-0961-4bb0-aafa-ae588e8f145a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:43.463525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f46265-0961-4bb0-aafa-ae588e8f145a service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:43.472968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 722/1402] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:43.539198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99c23-ccde-4f29-a9e5-0f751f11c1cf None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:43.539515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99c23-ccde-4f29-a9e5-0f751f11c1cf None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:43.539795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e99c23-ccde-4f29-a9e5-0f751f11c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:43.593931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b3e99c23-ccde-4f29-a9e5-0f751f11c1cf None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:43.595175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b3e99c23-ccde-4f29-a9e5-0f751f11c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:43.667296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 681/1403] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:14:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:43.721097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8d2c5-a907-4438-b47c-15f608fb6b1b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:43.721379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8d2c5-a907-4438-b47c-15f608fb6b1b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:43.721663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8d2c5-a907-4438-b47c-15f608fb6b1b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:43.723043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 723/1404] 10.222.0.77 () {54 vars in 942 bytes} [Tue Jun 7 14:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:43.732036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe946-8ecb-4fa0-adc1-f51306fad3c4 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:43.732329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe946-8ecb-4fa0-adc1-f51306fad3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:43.732599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe946-8ecb-4fa0-adc1-f51306fad3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:43.783776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-2e7fe946-8ecb-4fa0-adc1-f51306fad3c4 None None] MFA Rules not processed for user `ee8475d17d2349559125d2bcd969b9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:43.785760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2e7fe946-8ecb-4fa0-adc1-f51306fad3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:43.820900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:14:43.867471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 682/1405] 10.222.0.77 () {58 vars in 1039 bytes} [Tue Jun 7 14:14:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:43.878805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8d2c5-a907-4438-b47c-15f608fb6b1b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:43.893104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8d2c5-a907-4438-b47c-15f608fb6b1b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:43.898584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abeb206-7094-45a4-9819-4435fde9d74b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:43.899291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb206-7094-45a4-9819-4435fde9d74b service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:43.899695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb206-7094-45a4-9819-4435fde9d74b service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:43.900037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abeb206-7094-45a4-9819-4435fde9d74b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:43.908686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abeb206-7094-45a4-9819-4435fde9d74b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:43.910364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abeb206-7094-45a4-9819-4435fde9d74b service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:43.924170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 724/1406] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:14:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:14:45.823918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ccc1-2b01-4f74-94c9-f006202dcdcd None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:45.825216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ccc1-2b01-4f74-94c9-f006202dcdcd None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:45.825583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ccc1-2b01-4f74-94c9-f006202dcdcd None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:45.827047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 683/1407] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:14:45.833333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30ffa-3a1e-43ed-b5bb-f707ce7c6066 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:45.833765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30ffa-3a1e-43ed-b5bb-f707ce7c6066 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:45.833875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30ffa-3a1e-43ed-b5bb-f707ce7c6066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:45.854091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5af30ffa-3a1e-43ed-b5bb-f707ce7c6066 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:14:45.855609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5af30ffa-3a1e-43ed-b5bb-f707ce7c6066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:14:45.869763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 725/1408] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:14:45.909742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ccc1-2b01-4f74-94c9-f006202dcdcd None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:14:45.925413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ccc1-2b01-4f74-94c9-f006202dcdcd None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:14:45.931066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8889f37-4958-4538-a4c3-7c998864583c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:14:45.933648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889f37-4958-4538-a4c3-7c998864583c service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:14:45.933995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889f37-4958-4538-a4c3-7c998864583c service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:14:45.934342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8889f37-4958-4538-a4c3-7c998864583c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:14:45.943280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8889f37-4958-4538-a4c3-7c998864583c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:14:45.944884 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8889f37-4958-4538-a4c3-7c998864583c service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:14:45.955115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 684/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:14:55.977817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=55 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:14:55.982146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=21 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:15:07.085924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb0a3-fa64-4e1d-88e2-078fca516869 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:07.086498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb0a3-fa64-4e1d-88e2-078fca516869 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:07.086498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb0a3-fa64-4e1d-88e2-078fca516869 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:07.087868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 726/1410] 10.222.0.77 () {54 vars in 918 bytes} [Tue Jun 7 14:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:07.092798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff54ed-b448-48b8-9142-62c0b7600a06 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:07.093225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff54ed-b448-48b8-9142-62c0b7600a06 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:07.093383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff54ed-b448-48b8-9142-62c0b7600a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:07.111765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b8ff54ed-b448-48b8-9142-62c0b7600a06 None None] MFA Rules not processed for user `a0cc577feba04e66b950a69b918d4ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:07.112950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b8ff54ed-b448-48b8-9142-62c0b7600a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:07.121425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 685/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Tue Jun 7 14:15:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:07.135185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264fed-f33a-4993-b76a-8742fab488a6 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:07.135519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264fed-f33a-4993-b76a-8742fab488a6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:07.135832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264fed-f33a-4993-b76a-8742fab488a6 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:07.137175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 727/1412] 10.222.0.77 () {54 vars in 918 bytes} [Tue Jun 7 14:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:07.141521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecead7-a53e-4236-b065-741b81092cf1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:07.141811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecead7-a53e-4236-b065-741b81092cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:07.142091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecead7-a53e-4236-b065-741b81092cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:07.160157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8fecead7-a53e-4236-b065-741b81092cf1 None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:07.161349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8fecead7-a53e-4236-b065-741b81092cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:07.171023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 686/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Tue Jun 7 14:15:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:09.868220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0a3e-4853-4f62-92f8-9b14bab7bfba None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:09.868682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0a3e-4853-4f62-92f8-9b14bab7bfba None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:09.868798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0a3e-4853-4f62-92f8-9b14bab7bfba None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:09.870137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 728/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:09.875259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e661-782a-404f-9fa4-07b484d2f915 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:09.875698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e661-782a-404f-9fa4-07b484d2f915 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:09.875864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e661-782a-404f-9fa4-07b484d2f915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:09.894261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-3347e661-782a-404f-9fa4-07b484d2f915 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:09.895460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3347e661-782a-404f-9fa4-07b484d2f915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:09.903664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 687/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:09.946117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0a3e-4853-4f62-92f8-9b14bab7bfba None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:09.960610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0a3e-4853-4f62-92f8-9b14bab7bfba None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:09.965831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a34e8-2519-4e88-8927-93ca1a749beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:09.966468 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a34e8-2519-4e88-8927-93ca1a749beb service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:09.966749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a34e8-2519-4e88-8927-93ca1a749beb service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:09.967023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a34e8-2519-4e88-8927-93ca1a749beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:09.975411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a34e8-2519-4e88-8927-93ca1a749beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:09.976987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a34e8-2519-4e88-8927-93ca1a749beb service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:09.986208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 729/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:10.965986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40955d-a334-4236-9db1-a1cd69ecf327 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:10.966558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40955d-a334-4236-9db1-a1cd69ecf327 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:10.966558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40955d-a334-4236-9db1-a1cd69ecf327 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:10.967960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 688/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:10.972766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7af15c-c852-440a-b5d9-cb001a605783 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:10.973155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7af15c-c852-440a-b5d9-cb001a605783 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:10.973322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7af15c-c852-440a-b5d9-cb001a605783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:10.991485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ba7af15c-c852-440a-b5d9-cb001a605783 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:10.992671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ba7af15c-c852-440a-b5d9-cb001a605783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:11.000326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 730/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:11.150626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40955d-a334-4236-9db1-a1cd69ecf327 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:11.165044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40955d-a334-4236-9db1-a1cd69ecf327 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:11.170359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e8bd1-26c5-4fd7-b10f-6510cf4a37ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:11.170981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e8bd1-26c5-4fd7-b10f-6510cf4a37ca service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:11.171258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e8bd1-26c5-4fd7-b10f-6510cf4a37ca service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:11.171557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e8bd1-26c5-4fd7-b10f-6510cf4a37ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:11.180151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e8bd1-26c5-4fd7-b10f-6510cf4a37ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:11.181727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e8bd1-26c5-4fd7-b10f-6510cf4a37ca service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:11.191205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 689/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:15:12.110554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5cd33-0b6e-4d3b-9e16-8c3bee14e66b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:12.111087 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5cd33-0b6e-4d3b-9e16-8c3bee14e66b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:12.111087 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5cd33-0b6e-4d3b-9e16-8c3bee14e66b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:12.112544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 731/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:12.117363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89381a-13d8-4e01-a620-3c30414829c0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:12.117750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89381a-13d8-4e01-a620-3c30414829c0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:12.117924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89381a-13d8-4e01-a620-3c30414829c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:12.135948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-af89381a-13d8-4e01-a620-3c30414829c0 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:12.137140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-af89381a-13d8-4e01-a620-3c30414829c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:12.144856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 690/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:12.293463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5cd33-0b6e-4d3b-9e16-8c3bee14e66b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:12.308141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5cd33-0b6e-4d3b-9e16-8c3bee14e66b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:12.313535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66122d96-fc09-4c63-b6df-b498d5b082fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:12.314166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66122d96-fc09-4c63-b6df-b498d5b082fc service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:12.314454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66122d96-fc09-4c63-b6df-b498d5b082fc service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:12.314731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66122d96-fc09-4c63-b6df-b498d5b082fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:12.323659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66122d96-fc09-4c63-b6df-b498d5b082fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:12.325219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66122d96-fc09-4c63-b6df-b498d5b082fc service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:12.335408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 732/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:13.236761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93705c-d989-429a-9adf-0c5b6f56d1c3 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:13.237327 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93705c-d989-429a-9adf-0c5b6f56d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:13.237327 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93705c-d989-429a-9adf-0c5b6f56d1c3 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:13.238673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 691/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:13.244312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8a6cf-cbcf-4455-9ed8-0625261b82c9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:13.244743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8a6cf-cbcf-4455-9ed8-0625261b82c9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:13.244853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8a6cf-cbcf-4455-9ed8-0625261b82c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:13.263163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4ee8a6cf-cbcf-4455-9ed8-0625261b82c9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:13.264373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4ee8a6cf-cbcf-4455-9ed8-0625261b82c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:13.272366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 733/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:13.422264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93705c-d989-429a-9adf-0c5b6f56d1c3 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:13.437046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93705c-d989-429a-9adf-0c5b6f56d1c3 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:13.442301 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88a7de-8f5b-4aca-b3a5-f7b2f107a3d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:13.442925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a7de-8f5b-4aca-b3a5-f7b2f107a3d4 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:13.443208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a7de-8f5b-4aca-b3a5-f7b2f107a3d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:13.443509 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a7de-8f5b-4aca-b3a5-f7b2f107a3d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:13.451687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88a7de-8f5b-4aca-b3a5-f7b2f107a3d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:13.453263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88a7de-8f5b-4aca-b3a5-f7b2f107a3d4 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:13.462564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 692/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:14.363172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67e5c5-fc5b-4f03-9801-e3751af8fcfe None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:14.363778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67e5c5-fc5b-4f03-9801-e3751af8fcfe None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:14.363778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67e5c5-fc5b-4f03-9801-e3751af8fcfe None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:14.365752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 734/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:14.370564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09baa7-e32a-4927-9472-24b5ddc35c6d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:14.371023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09baa7-e32a-4927-9472-24b5ddc35c6d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:14.371151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09baa7-e32a-4927-9472-24b5ddc35c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:14.388802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-bd09baa7-e32a-4927-9472-24b5ddc35c6d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:14.389990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-bd09baa7-e32a-4927-9472-24b5ddc35c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:14.398324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 693/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:14.547894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67e5c5-fc5b-4f03-9801-e3751af8fcfe None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:14.562006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67e5c5-fc5b-4f03-9801-e3751af8fcfe None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:14.567305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61dccf-3db1-4714-949a-4ee2a3adb555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:14.567954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61dccf-3db1-4714-949a-4ee2a3adb555 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:14.568234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61dccf-3db1-4714-949a-4ee2a3adb555 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:14.568536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61dccf-3db1-4714-949a-4ee2a3adb555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:14.576764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61dccf-3db1-4714-949a-4ee2a3adb555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:14.578313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61dccf-3db1-4714-949a-4ee2a3adb555 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:14.588026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 735/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:15.432222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d74ee7-1800-406c-97e6-6ae9f302b1db None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:15.432764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d74ee7-1800-406c-97e6-6ae9f302b1db None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:15.432764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d74ee7-1800-406c-97e6-6ae9f302b1db None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:15.434152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 694/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:15.439212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16272065-0c52-4cab-8461-b868db4163be None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:15.439674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16272065-0c52-4cab-8461-b868db4163be None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:15.439800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16272065-0c52-4cab-8461-b868db4163be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:15.458296 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-16272065-0c52-4cab-8461-b868db4163be None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:15.459511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-16272065-0c52-4cab-8461-b868db4163be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:15.467246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 736/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:15.615487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d74ee7-1800-406c-97e6-6ae9f302b1db None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:15.629915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d74ee7-1800-406c-97e6-6ae9f302b1db None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:15.635294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe436e-ccf7-4517-a386-d3e202439607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:15.635953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe436e-ccf7-4517-a386-d3e202439607 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:15.636234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe436e-ccf7-4517-a386-d3e202439607 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:15.636510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe436e-ccf7-4517-a386-d3e202439607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:15.644491 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe436e-ccf7-4517-a386-d3e202439607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:15.646056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe436e-ccf7-4517-a386-d3e202439607 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:15.655290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 695/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:15:16.510679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dd028-5193-441e-8625-caa244466f1b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:16.511177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dd028-5193-441e-8625-caa244466f1b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:16.511275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dd028-5193-441e-8625-caa244466f1b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:16.512651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 737/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:16.517739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1826-24df-4944-a427-76ef93994b4d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:16.518177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1826-24df-4944-a427-76ef93994b4d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:16.518289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1826-24df-4944-a427-76ef93994b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:16.536453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7d2e1826-24df-4944-a427-76ef93994b4d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:16.537644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7d2e1826-24df-4944-a427-76ef93994b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:16.545412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 696/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:16.694440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dd028-5193-441e-8625-caa244466f1b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:16.708772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dd028-5193-441e-8625-caa244466f1b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:16.714080 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982bf2e-9394-4f29-b5b2-8176dd96e3ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:16.714695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982bf2e-9394-4f29-b5b2-8176dd96e3ef service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:16.714979 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982bf2e-9394-4f29-b5b2-8176dd96e3ef service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:16.715257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982bf2e-9394-4f29-b5b2-8176dd96e3ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:16.723426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982bf2e-9394-4f29-b5b2-8176dd96e3ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:16.724989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982bf2e-9394-4f29-b5b2-8176dd96e3ef service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:16.734253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 738/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:17.577407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6405-4849-4775-900f-7295f437db4e None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:17.577987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6405-4849-4775-900f-7295f437db4e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:17.577987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6405-4849-4775-900f-7295f437db4e None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:17.579320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 697/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:17.584678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90778e-4fce-45b2-b0f1-42d5cede86aa None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:17.585096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90778e-4fce-45b2-b0f1-42d5cede86aa None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:17.585222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90778e-4fce-45b2-b0f1-42d5cede86aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:17.603444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3d90778e-4fce-45b2-b0f1-42d5cede86aa None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:17.604621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3d90778e-4fce-45b2-b0f1-42d5cede86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:17.612246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 739/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:17.759389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c6405-4849-4775-900f-7295f437db4e None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:17.774197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c6405-4849-4775-900f-7295f437db4e None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:17.779682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196a405-4358-4478-acaa-4cb04b358433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:17.780321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196a405-4358-4478-acaa-4cb04b358433 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:17.780604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196a405-4358-4478-acaa-4cb04b358433 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:17.780880 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196a405-4358-4478-acaa-4cb04b358433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:17.788947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196a405-4358-4478-acaa-4cb04b358433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:17.790530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196a405-4358-4478-acaa-4cb04b358433 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:17.799898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 698/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:18.651842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f233809-cb6c-4088-9b76-1684a3417f74 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:18.652473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f233809-cb6c-4088-9b76-1684a3417f74 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:18.652473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f233809-cb6c-4088-9b76-1684a3417f74 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:18.653744 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 740/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:18.658677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4cb8-147e-4e33-ac67-c5063bab6fe1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:18.659065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4cb8-147e-4e33-ac67-c5063bab6fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:18.659290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff4cb8-147e-4e33-ac67-c5063bab6fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:18.676898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1bff4cb8-147e-4e33-ac67-c5063bab6fe1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:18.678071 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1bff4cb8-147e-4e33-ac67-c5063bab6fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:18.685732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 699/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:15:18.841073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f233809-cb6c-4088-9b76-1684a3417f74 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:18.855103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f233809-cb6c-4088-9b76-1684a3417f74 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:18.860498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b916b-0429-4eb9-8ff6-b4a86d5fd9e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:18.861128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b916b-0429-4eb9-8ff6-b4a86d5fd9e9 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:18.861413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b916b-0429-4eb9-8ff6-b4a86d5fd9e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:18.861692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b916b-0429-4eb9-8ff6-b4a86d5fd9e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:18.869682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b916b-0429-4eb9-8ff6-b4a86d5fd9e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:18.871244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b916b-0429-4eb9-8ff6-b4a86d5fd9e9 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:18.881315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 741/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:20.977689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf574e2-c4af-4fbd-a661-6dece9a382a2 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:20.978220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf574e2-c4af-4fbd-a661-6dece9a382a2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:20.978345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf574e2-c4af-4fbd-a661-6dece9a382a2 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:20.979663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 700/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:20.985020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d944b-0c6e-47b1-be86-61bbece2f276 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:20.985455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d944b-0c6e-47b1-be86-61bbece2f276 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:20.985550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d944b-0c6e-47b1-be86-61bbece2f276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:21.003088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a85d944b-0c6e-47b1-be86-61bbece2f276 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:21.004882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a85d944b-0c6e-47b1-be86-61bbece2f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:21.012548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 742/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:21.050246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf574e2-c4af-4fbd-a661-6dece9a382a2 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:21.060873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf574e2-c4af-4fbd-a661-6dece9a382a2 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:21.064409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948b1db-e5fb-49cb-a721-a3c4ba36d47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:21.065038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948b1db-e5fb-49cb-a721-a3c4ba36d47a service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:21.065321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948b1db-e5fb-49cb-a721-a3c4ba36d47a service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:21.065595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948b1db-e5fb-49cb-a721-a3c4ba36d47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:21.075138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948b1db-e5fb-49cb-a721-a3c4ba36d47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:21.076595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948b1db-e5fb-49cb-a721-a3c4ba36d47a service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:21.086647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 701/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:23.422669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d5949-3304-42e0-a76f-f8ec5d9ea2ec None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:23.423301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d5949-3304-42e0-a76f-f8ec5d9ea2ec None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:23.423301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d5949-3304-42e0-a76f-f8ec5d9ea2ec None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:23.424632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 743/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:23.430558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8de09d-8a9c-48b3-ae65-81764fb8ae75 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:23.431044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8de09d-8a9c-48b3-ae65-81764fb8ae75 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:23.431193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8de09d-8a9c-48b3-ae65-81764fb8ae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:23.449444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-df8de09d-8a9c-48b3-ae65-81764fb8ae75 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:23.450640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-df8de09d-8a9c-48b3-ae65-81764fb8ae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:23.458466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 702/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:23.496946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d5949-3304-42e0-a76f-f8ec5d9ea2ec None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:23.508233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d5949-3304-42e0-a76f-f8ec5d9ea2ec None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:23.511732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeec3a-5c2e-4f3c-9a28-2aeac6dd5054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:23.512364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeec3a-5c2e-4f3c-9a28-2aeac6dd5054 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:23.512642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeec3a-5c2e-4f3c-9a28-2aeac6dd5054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:23.512915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeec3a-5c2e-4f3c-9a28-2aeac6dd5054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:23.521655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeec3a-5c2e-4f3c-9a28-2aeac6dd5054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:23.523040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aeec3a-5c2e-4f3c-9a28-2aeac6dd5054 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:23.532272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 744/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:26.088001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f691e-ccd3-4f33-8f47-561cc345c8c8 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:26.088561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f691e-ccd3-4f33-8f47-561cc345c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:26.088561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f691e-ccd3-4f33-8f47-561cc345c8c8 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:26.089935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 703/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:26.095126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd668c-414d-42d8-95f4-1a2c09c89b97 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:26.095558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd668c-414d-42d8-95f4-1a2c09c89b97 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:26.095834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd668c-414d-42d8-95f4-1a2c09c89b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:26.114182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-04bd668c-414d-42d8-95f4-1a2c09c89b97 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:26.115288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-04bd668c-414d-42d8-95f4-1a2c09c89b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:26.122926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 745/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:26.161154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f691e-ccd3-4f33-8f47-561cc345c8c8 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:26.171775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f691e-ccd3-4f33-8f47-561cc345c8c8 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:26.175257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcf182-31de-4cc8-8539-51b25ee8bb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:26.175914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcf182-31de-4cc8-8539-51b25ee8bb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:26.176197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcf182-31de-4cc8-8539-51b25ee8bb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:26.176473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcf182-31de-4cc8-8539-51b25ee8bb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:26.185230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcf182-31de-4cc8-8539-51b25ee8bb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:26.186638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dcf182-31de-4cc8-8539-51b25ee8bb4b service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:26.196472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 704/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:28.564904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4f62-8487-40ed-8fde-52679e00a2e0 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:28.565471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4f62-8487-40ed-8fde-52679e00a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:28.565471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf4f62-8487-40ed-8fde-52679e00a2e0 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:28.566798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 746/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:28.572163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22a4f-1f35-4236-9e27-3e7dba0c4bb9 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:28.572852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22a4f-1f35-4236-9e27-3e7dba0c4bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:28.572990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22a4f-1f35-4236-9e27-3e7dba0c4bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:28.590221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-62a22a4f-1f35-4236-9e27-3e7dba0c4bb9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:28.591436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-62a22a4f-1f35-4236-9e27-3e7dba0c4bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:28.599770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 705/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:28.637882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf4f62-8487-40ed-8fde-52679e00a2e0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:28.648958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf4f62-8487-40ed-8fde-52679e00a2e0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:28.652449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f193f-e251-49a5-82cb-463a15177412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:28.653078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f193f-e251-49a5-82cb-463a15177412 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:28.653361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f193f-e251-49a5-82cb-463a15177412 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:28.653631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f193f-e251-49a5-82cb-463a15177412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:28.662852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f193f-e251-49a5-82cb-463a15177412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:28.664288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f193f-e251-49a5-82cb-463a15177412 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:28.673434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 747/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:31.070419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c4a6f-c2c7-474b-a145-04cd06dd6453 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:31.070991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c4a6f-c2c7-474b-a145-04cd06dd6453 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:31.070991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c4a6f-c2c7-474b-a145-04cd06dd6453 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:31.072649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 706/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:31.077985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3a041-aa2d-4da0-891f-6e3e935dc903 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:31.078406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3a041-aa2d-4da0-891f-6e3e935dc903 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:31.078534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3a041-aa2d-4da0-891f-6e3e935dc903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:31.096339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d9e3a041-aa2d-4da0-891f-6e3e935dc903 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:31.098104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d9e3a041-aa2d-4da0-891f-6e3e935dc903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:31.105788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 748/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:15:31.142863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c4a6f-c2c7-474b-a145-04cd06dd6453 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:31.154100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c4a6f-c2c7-474b-a145-04cd06dd6453 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:31.157665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812e8d9-2b43-41e5-bc9b-1e8135638258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:31.158291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812e8d9-2b43-41e5-bc9b-1e8135638258 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:31.158577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812e8d9-2b43-41e5-bc9b-1e8135638258 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:31.158854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812e8d9-2b43-41e5-bc9b-1e8135638258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:31.168349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812e8d9-2b43-41e5-bc9b-1e8135638258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:31.169764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812e8d9-2b43-41e5-bc9b-1e8135638258 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:31.179154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 707/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:33.458554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a7b0a-0b99-4359-9f53-5f876be43d01 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:33.459126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a7b0a-0b99-4359-9f53-5f876be43d01 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:33.459126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a7b0a-0b99-4359-9f53-5f876be43d01 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:33.460509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 749/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:33.465689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2272d-091b-4b44-8c60-2564460f2905 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:33.466131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2272d-091b-4b44-8c60-2564460f2905 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:33.466230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2272d-091b-4b44-8c60-2564460f2905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:33.484562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-94b2272d-091b-4b44-8c60-2564460f2905 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:33.485784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-94b2272d-091b-4b44-8c60-2564460f2905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:33.493792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 708/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:33.532627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a7b0a-0b99-4359-9f53-5f876be43d01 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:33.543309 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a7b0a-0b99-4359-9f53-5f876be43d01 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:33.546826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da387378-614a-4a25-879d-0119fae93965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:33.547500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387378-614a-4a25-879d-0119fae93965 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:33.547786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387378-614a-4a25-879d-0119fae93965 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:33.548061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da387378-614a-4a25-879d-0119fae93965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:33.556824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da387378-614a-4a25-879d-0119fae93965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:33.558238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da387378-614a-4a25-879d-0119fae93965 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:33.568304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 750/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:35.827446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa58c-1a1e-4622-bed1-ba41e5534576 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:35.827956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa58c-1a1e-4622-bed1-ba41e5534576 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:35.827956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa58c-1a1e-4622-bed1-ba41e5534576 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:35.829304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 709/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:35.835119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177431-c77a-4563-8aae-a9d3d48ead12 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:35.835593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177431-c77a-4563-8aae-a9d3d48ead12 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:35.835704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177431-c77a-4563-8aae-a9d3d48ead12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:35.852980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d7177431-c77a-4563-8aae-a9d3d48ead12 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:35.854164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d7177431-c77a-4563-8aae-a9d3d48ead12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:35.862191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 751/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:35.900225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa58c-1a1e-4622-bed1-ba41e5534576 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:35.910822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa58c-1a1e-4622-bed1-ba41e5534576 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:35.914251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7fc44-d1f4-4201-9cae-003d10e915be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:35.914879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7fc44-d1f4-4201-9cae-003d10e915be service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:35.915160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7fc44-d1f4-4201-9cae-003d10e915be service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:35.915487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7fc44-d1f4-4201-9cae-003d10e915be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:35.924425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7fc44-d1f4-4201-9cae-003d10e915be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:35.925851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7fc44-d1f4-4201-9cae-003d10e915be service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:35.935144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 710/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:38.211675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125bc6b-ca65-4e7c-9961-63078069eafa None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:38.212243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125bc6b-ca65-4e7c-9961-63078069eafa None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:38.212352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125bc6b-ca65-4e7c-9961-63078069eafa None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:38.213720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 752/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:38.219009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e063e-9539-40d3-96a8-d23a4a882d14 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:38.219438 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e063e-9539-40d3-96a8-d23a4a882d14 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:38.219602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e063e-9539-40d3-96a8-d23a4a882d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:38.225646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=79 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:15:38.238228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-563e063e-9539-40d3-96a8-d23a4a882d14 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:38.239467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-563e063e-9539-40d3-96a8-d23a4a882d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:38.247255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 711/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:38.284574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125bc6b-ca65-4e7c-9961-63078069eafa None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:38.290041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=73 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:15:38.296368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125bc6b-ca65-4e7c-9961-63078069eafa None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:38.299948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a88572-af15-44c9-9b9f-ec4dcd8d9da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:38.300581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a88572-af15-44c9-9b9f-ec4dcd8d9da9 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:38.300862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a88572-af15-44c9-9b9f-ec4dcd8d9da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:38.301138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a88572-af15-44c9-9b9f-ec4dcd8d9da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:38.309987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a88572-af15-44c9-9b9f-ec4dcd8d9da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:38.311438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a88572-af15-44c9-9b9f-ec4dcd8d9da9 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:38.321221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 753/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:15:40.571221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92534ee-72fe-4985-8b36-69aedca67d4f None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:40.572015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92534ee-72fe-4985-8b36-69aedca67d4f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:40.572114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92534ee-72fe-4985-8b36-69aedca67d4f None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:40.573474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 712/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:40.578817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d881-6599-41bd-b1ce-ce36dbe7c75e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:40.579252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d881-6599-41bd-b1ce-ce36dbe7c75e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:40.579426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d881-6599-41bd-b1ce-ce36dbe7c75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:40.597503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5069d881-6599-41bd-b1ce-ce36dbe7c75e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:40.598725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5069d881-6599-41bd-b1ce-ce36dbe7c75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:40.606516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 754/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:40.642787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92534ee-72fe-4985-8b36-69aedca67d4f None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:40.653906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92534ee-72fe-4985-8b36-69aedca67d4f None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:40.657442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa98456-6ea6-47b4-8afe-61f689c1f618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:40.658068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa98456-6ea6-47b4-8afe-61f689c1f618 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:40.658351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa98456-6ea6-47b4-8afe-61f689c1f618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:40.658622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa98456-6ea6-47b4-8afe-61f689c1f618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:40.667965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa98456-6ea6-47b4-8afe-61f689c1f618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:40.669380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa98456-6ea6-47b4-8afe-61f689c1f618 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:40.678667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 713/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:42.918616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe87f23-7202-437f-a628-b81e4406a08f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:42.919184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe87f23-7202-437f-a628-b81e4406a08f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:42.919184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe87f23-7202-437f-a628-b81e4406a08f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:42.920586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 755/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:15:42.926273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bc3eb-5c09-4b46-ac8e-5ca66160d80b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:42.926685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bc3eb-5c09-4b46-ac8e-5ca66160d80b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:42.926866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bc3eb-5c09-4b46-ac8e-5ca66160d80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:42.945140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-170bc3eb-5c09-4b46-ac8e-5ca66160d80b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:15:42.946326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-170bc3eb-5c09-4b46-ac8e-5ca66160d80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:15:42.954185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 714/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:15:42.990854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe87f23-7202-437f-a628-b81e4406a08f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:15:43.001344 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe87f23-7202-437f-a628-b81e4406a08f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:15:43.005488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394f67e-cc04-4c7c-97cb-1361b303be30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:15:43.006109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394f67e-cc04-4c7c-97cb-1361b303be30 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:15:43.006387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394f67e-cc04-4c7c-97cb-1361b303be30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:15:43.006660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394f67e-cc04-4c7c-97cb-1361b303be30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:15:43.015313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394f67e-cc04-4c7c-97cb-1361b303be30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:15:43.016737 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394f67e-cc04-4c7c-97cb-1361b303be30 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:15:43.025803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 756/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:15:52.939840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=11 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:15:53.021803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=14 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:16:14.692312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb96fb-5016-4985-8d22-35d94ab4719e None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:14.692900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb96fb-5016-4985-8d22-35d94ab4719e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:14.692900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb96fb-5016-4985-8d22-35d94ab4719e None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:14.694242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 715/1471] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:16:14.699851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdfe90-520e-46a4-886f-7b044499b07b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:14.700280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdfe90-520e-46a4-886f-7b044499b07b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:14.700440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdfe90-520e-46a4-886f-7b044499b07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:14.719435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b8cdfe90-520e-46a4-886f-7b044499b07b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:16:14.720629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b8cdfe90-520e-46a4-886f-7b044499b07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:16:14.728368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 757/1472] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:16:14.775539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8209e-2d10-4731-82a1-0ec359e31d7d None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:14.775833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8209e-2d10-4731-82a1-0ec359e31d7d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:14.776114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8209e-2d10-4731-82a1-0ec359e31d7d None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:14.777476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 716/1473] 10.222.0.77 () {54 vars in 962 bytes} [Tue Jun 7 14:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:16:14.782143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6e4b-2c3f-449d-ad4e-9a6ad36104e0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:14.782435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6e4b-2c3f-449d-ad4e-9a6ad36104e0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:14.782732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6e4b-2c3f-449d-ad4e-9a6ad36104e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:14.800265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-355f6e4b-2c3f-449d-ad4e-9a6ad36104e0 None None] MFA Rules not processed for user `a418c5817e784d299c8d6daad20c6cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:16:14.801446 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-355f6e4b-2c3f-449d-ad4e-9a6ad36104e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:16:14.807736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 758/1474] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Jun 7 14:16:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:16:14.815103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8209e-2d10-4731-82a1-0ec359e31d7d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:16:14.825855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8209e-2d10-4731-82a1-0ec359e31d7d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:16:14.829935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6cdbd-abe6-4881-aaba-ec2843c355a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a418c5817e784d299c8d6daad20c6cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:16:14.830555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6cdbd-abe6-4881-aaba-ec2843c355a2 service glance] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:14.830839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6cdbd-abe6-4881-aaba-ec2843c355a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:14.831114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6cdbd-abe6-4881-aaba-ec2843c355a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:14.840023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6cdbd-abe6-4881-aaba-ec2843c355a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:16:14.841443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6cdbd-abe6-4881-aaba-ec2843c355a2 service glance] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:16:14.850736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 717/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:16:17.137334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1294-3666-477d-a2bb-1a61dfcd8c30 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:17.137923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1294-3666-477d-a2bb-1a61dfcd8c30 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:17.137923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1294-3666-477d-a2bb-1a61dfcd8c30 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:17.139236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 759/1476] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:16:17.144543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc38a-ed27-42c4-930c-4eb99db40664 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:17.145065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc38a-ed27-42c4-930c-4eb99db40664 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:17.145233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc38a-ed27-42c4-930c-4eb99db40664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:17.163247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4e0bc38a-ed27-42c4-930c-4eb99db40664 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:16:17.164470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4e0bc38a-ed27-42c4-930c-4eb99db40664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:16:17.172783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 718/1477] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:16:17.195838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1294-3666-477d-a2bb-1a61dfcd8c30 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:16:17.207815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1294-3666-477d-a2bb-1a61dfcd8c30 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:16:17.212300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c851b47-199b-40fd-9a8a-2da78b97bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:16:17.212951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c851b47-199b-40fd-9a8a-2da78b97bd59 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:17.213237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c851b47-199b-40fd-9a8a-2da78b97bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:17.213518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c851b47-199b-40fd-9a8a-2da78b97bd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:17.214290 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c851b47-199b-40fd-9a8a-2da78b97bd59 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:16:17.216074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING py.warnings [None req-1c851b47-199b-40fd-9a8a-2da78b97bd59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:16:17.216074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: warnings.warn(msg) Jun 07 14:16:17.216074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: Jun 07 14:16:17.217231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c851b47-199b-40fd-9a8a-2da78b97bd59 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:16:17.237910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 760/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jun 7 14:16:17 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:16:19.486099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61264ca2-6bf7-4393-94cd-42b2688592ad None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:19.486658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61264ca2-6bf7-4393-94cd-42b2688592ad None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:19.486658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61264ca2-6bf7-4393-94cd-42b2688592ad None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:19.488100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 719/1479] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:16:19.493615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1462ce5-a10e-4986-b64b-2da0b957200e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:19.494069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1462ce5-a10e-4986-b64b-2da0b957200e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:19.494174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1462ce5-a10e-4986-b64b-2da0b957200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:19.511635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e1462ce5-a10e-4986-b64b-2da0b957200e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:16:19.512822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e1462ce5-a10e-4986-b64b-2da0b957200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:16:19.520415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 761/1480] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:16:19.563277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61264ca2-6bf7-4393-94cd-42b2688592ad None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:16:19.578072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61264ca2-6bf7-4393-94cd-42b2688592ad None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:16:19.583551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26869d18-6cff-420a-bcd6-f7f3a32a422e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:16:19.584190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26869d18-6cff-420a-bcd6-f7f3a32a422e service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:19.584472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26869d18-6cff-420a-bcd6-f7f3a32a422e service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:19.584754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26869d18-6cff-420a-bcd6-f7f3a32a422e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:19.593462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26869d18-6cff-420a-bcd6-f7f3a32a422e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:16:19.595018 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26869d18-6cff-420a-bcd6-f7f3a32a422e service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:16:19.604329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 720/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:16:22.024729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bf70d-24d0-4c7d-97b8-3f8b10afdb86 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:22.025268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bf70d-24d0-4c7d-97b8-3f8b10afdb86 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:22.025268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bf70d-24d0-4c7d-97b8-3f8b10afdb86 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:22.026665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 762/1482] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:16:22.032031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb683d-7738-4e4d-8f52-1c8403d5e4ef None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:22.032453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb683d-7738-4e4d-8f52-1c8403d5e4ef None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:22.032566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb683d-7738-4e4d-8f52-1c8403d5e4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:22.050133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-58eb683d-7738-4e4d-8f52-1c8403d5e4ef None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:16:22.051302 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-58eb683d-7738-4e4d-8f52-1c8403d5e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:16:22.059202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 721/1483] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:16:22.095925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bf70d-24d0-4c7d-97b8-3f8b10afdb86 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:16:22.106506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bf70d-24d0-4c7d-97b8-3f8b10afdb86 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:16:22.110583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbdc8e-0837-44f5-a71e-5e7c6df283bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:16:22.111214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbdc8e-0837-44f5-a71e-5e7c6df283bf service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:22.111533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbdc8e-0837-44f5-a71e-5e7c6df283bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:22.111815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbdc8e-0837-44f5-a71e-5e7c6df283bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:22.120724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbdc8e-0837-44f5-a71e-5e7c6df283bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:16:22.122150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbdc8e-0837-44f5-a71e-5e7c6df283bf service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:16:22.132172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 763/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:16:24.426788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7012bf-cfad-4fe4-bb23-f4583bbb3d7b None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:24.427379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7012bf-cfad-4fe4-bb23-f4583bbb3d7b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:24.427379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7012bf-cfad-4fe4-bb23-f4583bbb3d7b None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:24.428762 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 722/1485] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:16:24.435143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600967-3e84-4822-bca1-3c59a3dba0f2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:24.435616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600967-3e84-4822-bca1-3c59a3dba0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:24.435748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96600967-3e84-4822-bca1-3c59a3dba0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:24.453897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-96600967-3e84-4822-bca1-3c59a3dba0f2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:16:24.455125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-96600967-3e84-4822-bca1-3c59a3dba0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:16:24.463027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 764/1486] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:16:24.501084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7012bf-cfad-4fe4-bb23-f4583bbb3d7b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:16:24.511824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7012bf-cfad-4fe4-bb23-f4583bbb3d7b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:16:24.515429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab079464-58bb-46af-8079-c9783e301d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:16:24.516062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab079464-58bb-46af-8079-c9783e301d4e service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:24.516352 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab079464-58bb-46af-8079-c9783e301d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:24.516631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab079464-58bb-46af-8079-c9783e301d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:24.525431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab079464-58bb-46af-8079-c9783e301d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:16:24.526925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab079464-58bb-46af-8079-c9783e301d4e service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:16:24.537431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 723/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:16:26.859387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2868b-3852-4a8d-a2d5-5e6a063e4c51 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:26.859913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2868b-3852-4a8d-a2d5-5e6a063e4c51 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:26.859913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2868b-3852-4a8d-a2d5-5e6a063e4c51 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:26.861275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 765/1488] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:16:26.866534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3a2f7-ee39-4223-83f6-17a1b5b98b56 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:26.866967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3a2f7-ee39-4223-83f6-17a1b5b98b56 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:26.867076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3a2f7-ee39-4223-83f6-17a1b5b98b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:26.885375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-ddc3a2f7-ee39-4223-83f6-17a1b5b98b56 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:16:26.886544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ddc3a2f7-ee39-4223-83f6-17a1b5b98b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:16:26.895065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 724/1489] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:16:26.933868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2868b-3852-4a8d-a2d5-5e6a063e4c51 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:16:26.945280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2868b-3852-4a8d-a2d5-5e6a063e4c51 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:16:26.948790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecb184-d768-4156-8816-3d3efa7119a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:16:26.949416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecb184-d768-4156-8816-3d3efa7119a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:26.949699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecb184-d768-4156-8816-3d3efa7119a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:26.949972 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecb184-d768-4156-8816-3d3efa7119a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:26.959295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecb184-d768-4156-8816-3d3efa7119a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:16:26.960735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ecb184-d768-4156-8816-3d3efa7119a2 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:16:26.970244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 766/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:16:29.394817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172325-e62d-439f-8cbe-ad6fcbdcae71 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:29.395437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172325-e62d-439f-8cbe-ad6fcbdcae71 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:29.395437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172325-e62d-439f-8cbe-ad6fcbdcae71 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:29.396784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 725/1491] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jun 7 14:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:16:29.402265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060a5a1-8b30-4f73-8ae0-9111b1648f11 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:29.402717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060a5a1-8b30-4f73-8ae0-9111b1648f11 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:29.402825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060a5a1-8b30-4f73-8ae0-9111b1648f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:29.420659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f060a5a1-8b30-4f73-8ae0-9111b1648f11 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:16:29.421860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f060a5a1-8b30-4f73-8ae0-9111b1648f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:16:29.429791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 767/1492] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jun 7 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:16:29.468493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd172325-e62d-439f-8cbe-ad6fcbdcae71 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:16:29.479092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd172325-e62d-439f-8cbe-ad6fcbdcae71 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:16:29.482622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfef3cb-b5ae-4a17-a5b2-e4c3ac8e04fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:16:29.483248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef3cb-b5ae-4a17-a5b2-e4c3ac8e04fe service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:16:29.483575 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef3cb-b5ae-4a17-a5b2-e4c3ac8e04fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:16:29.483852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfef3cb-b5ae-4a17-a5b2-e4c3ac8e04fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:16:29.493246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef3cb-b5ae-4a17-a5b2-e4c3ac8e04fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:16:29.494900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfef3cb-b5ae-4a17-a5b2-e4c3ac8e04fe service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:16:29.504403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 726/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:16:39.415657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=33 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:16:39.500093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=33 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:17:54.750965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d859fa-203f-4f0f-b0e9-8e43e6ef8fff None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:54.751545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d859fa-203f-4f0f-b0e9-8e43e6ef8fff None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:54.751545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d859fa-203f-4f0f-b0e9-8e43e6ef8fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:54.769182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-61d859fa-203f-4f0f-b0e9-8e43e6ef8fff None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:17:54.770379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-61d859fa-203f-4f0f-b0e9-8e43e6ef8fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:17:54.778208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 768/1494] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:17:54.785816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdf68-7ce5-4aee-a8d7-b7990015ef2e None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:54.786316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdf68-7ce5-4aee-a8d7-b7990015ef2e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:54.786423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdf68-7ce5-4aee-a8d7-b7990015ef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:54.805200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-c4abdf68-7ce5-4aee-a8d7-b7990015ef2e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:17:54.806382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c4abdf68-7ce5-4aee-a8d7-b7990015ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:17:54.814257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 727/1495] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:17:54.818795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d859fa-203f-4f0f-b0e9-8e43e6ef8fff None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:54.828227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d859fa-203f-4f0f-b0e9-8e43e6ef8fff None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:54.832799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:54.833447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:54.833732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:54.834011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:54.834743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:17:54.835051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:54.836101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING py.warnings [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:17:54.836101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: warnings.warn(msg) Jun 07 14:17:54.836101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: Jun 07 14:17:54.836989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:54.848147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 769/1496] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:17:54.856583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abdf68-7ce5-4aee-a8d7-b7990015ef2e None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:54.865683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abdf68-7ce5-4aee-a8d7-b7990015ef2e None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:54.870872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426fd32-bf3c-409a-bd91-82dda494e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:54.871616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426fd32-bf3c-409a-bd91-82dda494e3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:54.871901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426fd32-bf3c-409a-bd91-82dda494e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:54.872180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426fd32-bf3c-409a-bd91-82dda494e3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:54.872871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426fd32-bf3c-409a-bd91-82dda494e3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:54.874597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WARNING py.warnings [None req-f426fd32-bf3c-409a-bd91-82dda494e3f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:17:54.874597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: warnings.warn(msg) Jun 07 14:17:54.874597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: Jun 07 14:17:54.875809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426fd32-bf3c-409a-bd91-82dda494e3f8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:54.910979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 728/1497] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:17:54 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:17:54.915781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:54.925619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e943eb5-4476-4d8c-ac27-08b6a500b41f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:54.980786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28deb3c5-a406-4222-8445-2336d4577146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:54.981460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb3c5-a406-4222-8445-2336d4577146 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:54.981747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb3c5-a406-4222-8445-2336d4577146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:54.982024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deb3c5-a406-4222-8445-2336d4577146 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:54.982715 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28deb3c5-a406-4222-8445-2336d4577146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:54.983748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING py.warnings [None req-28deb3c5-a406-4222-8445-2336d4577146 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:17:54.983748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: warnings.warn(msg) Jun 07 14:17:54.983748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: Jun 07 14:17:54.984944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28deb3c5-a406-4222-8445-2336d4577146 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:55.004318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 770/1498] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:17:54 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:17:55.008877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426fd32-bf3c-409a-bd91-82dda494e3f8 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:55.018950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426fd32-bf3c-409a-bd91-82dda494e3f8 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:55.023442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cd062-9f81-498a-b51c-c4cda48009ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:55.024099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cd062-9f81-498a-b51c-c4cda48009ac admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.024381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cd062-9f81-498a-b51c-c4cda48009ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.024659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cd062-9f81-498a-b51c-c4cda48009ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.025381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cd062-9f81-498a-b51c-c4cda48009ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:55.026378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WARNING py.warnings [None req-3c5cd062-9f81-498a-b51c-c4cda48009ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:17:55.026378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: warnings.warn(msg) Jun 07 14:17:55.026378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: Jun 07 14:17:55.027243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cd062-9f81-498a-b51c-c4cda48009ac admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:55.039531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 729/1499] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:17:55.043215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28deb3c5-a406-4222-8445-2336d4577146 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:55.052877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28deb3c5-a406-4222-8445-2336d4577146 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:55.057958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf02cf-f0c4-49f8-95e1-4fd9d8571220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:55.058603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf02cf-f0c4-49f8-95e1-4fd9d8571220 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.058881 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf02cf-f0c4-49f8-95e1-4fd9d8571220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.059156 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf02cf-f0c4-49f8-95e1-4fd9d8571220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.059925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf02cf-f0c4-49f8-95e1-4fd9d8571220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:55.060918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING py.warnings [None req-0fdf02cf-f0c4-49f8-95e1-4fd9d8571220 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:17:55.060918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: warnings.warn(msg) Jun 07 14:17:55.060918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: Jun 07 14:17:55.061784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf02cf-f0c4-49f8-95e1-4fd9d8571220 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:55.076838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 771/1500] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:17:55.080981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cd062-9f81-498a-b51c-c4cda48009ac admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:55.092613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cd062-9f81-498a-b51c-c4cda48009ac admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:55.097294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772474c-0458-4028-9cc4-a6b2e544a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:55.098183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772474c-0458-4028-9cc4-a6b2e544a2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.098480 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772474c-0458-4028-9cc4-a6b2e544a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.098739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772474c-0458-4028-9cc4-a6b2e544a2fd admin admin] PATH_INFO: `/v3/projects/9a6f62b5a4c64810b8fdfbef6b2f2b36/users/be54b477a89547838262c7f4648c1ce3/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.113554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772474c-0458-4028-9cc4-a6b2e544a2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6f62b5a4c64810b8fdfbef6b2f2b36, user_id=be54b477a89547838262c7f4648c1ce3, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:55.114586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WARNING py.warnings [None req-2772474c-0458-4028-9cc4-a6b2e544a2fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:17:55.114586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: warnings.warn(msg) Jun 07 14:17:55.114586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: Jun 07 14:17:55.117063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772474c-0458-4028-9cc4-a6b2e544a2fd admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:55.129774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 730/1501] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:17:55 2022] PUT /identity/v3/projects/9a6f62b5a4c64810b8fdfbef6b2f2b36/users/be54b477a89547838262c7f4648c1ce3/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:17:55.142387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be17d-b03a-45db-ae36-f6fdf5cf465f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.142673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be17d-b03a-45db-ae36-f6fdf5cf465f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.142946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be17d-b03a-45db-ae36-f6fdf5cf465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.168230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8a6be17d-b03a-45db-ae36-f6fdf5cf465f None None] MFA Rules not processed for user `be54b477a89547838262c7f4648c1ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:17:55.169472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8a6be17d-b03a-45db-ae36-f6fdf5cf465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:17:55.230971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 772/1502] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:17:55.244693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990fec-229a-4793-8992-424e895645fc None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.244990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990fec-229a-4793-8992-424e895645fc None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.245277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990fec-229a-4793-8992-424e895645fc None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.246667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 731/1503] 10.222.0.77 () {54 vars in 963 bytes} [Tue Jun 7 14:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:17:55.251470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaa38b-4144-4e19-bb75-9bf57e3cebdc None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.251782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaa38b-4144-4e19-bb75-9bf57e3cebdc None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.252059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaa38b-4144-4e19-bb75-9bf57e3cebdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.269758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bbeaa38b-4144-4e19-bb75-9bf57e3cebdc None None] MFA Rules not processed for user `dbba49c3d7c24cd699d85fb93c76e7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:17:55.270860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bbeaa38b-4144-4e19-bb75-9bf57e3cebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:17:55.312850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:17:55.321152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 773/1504] 10.222.0.77 () {58 vars in 1060 bytes} [Tue Jun 7 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:17:55.328673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac990fec-229a-4793-8992-424e895645fc None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:55.339006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac990fec-229a-4793-8992-424e895645fc None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:55.342516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9f9a9-ae48-4937-b29d-b5a39e3de09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:55.343142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9f9a9-ae48-4937-b29d-b5a39e3de09f service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.343463 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9f9a9-ae48-4937-b29d-b5a39e3de09f service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.343741 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9f9a9-ae48-4937-b29d-b5a39e3de09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.352358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9f9a9-ae48-4937-b29d-b5a39e3de09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:55.353828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9f9a9-ae48-4937-b29d-b5a39e3de09f service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:55.362572 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 732/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:17:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:17:55.403728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d18239-9823-4c13-9545-5706862c467b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.404014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d18239-9823-4c13-9545-5706862c467b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.404291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d18239-9823-4c13-9545-5706862c467b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.405592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 774/1506] 10.222.0.77 () {52 vars in 829 bytes} [Tue Jun 7 14:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:17:55.409061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9f9a9-ae48-4937-b29d-b5a39e3de09f service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:55.469462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9f9a9-ae48-4937-b29d-b5a39e3de09f service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:55.473894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:55.474747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.475026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.475824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] PATH_INFO: `/v3/users/be54b477a89547838262c7f4648c1ce3` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.476994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=be54b477a89547838262c7f4648c1ce3)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:55.477995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WARNING py.warnings [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:17:55.477995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: warnings.warn(msg) Jun 07 14:17:55.477995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: Jun 07 14:17:55.479177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:55.543188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be54b477a89547838262c7f4648c1ce3'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:55.543876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be54b477a89547838262c7f4648c1ce3'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:55.556298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be54b477a89547838262c7f4648c1ce3'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:55.556933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be54b477a89547838262c7f4648c1ce3'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:55.566287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be54b477a89547838262c7f4648c1ce3'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:55.582287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:17:55.591899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 733/1507] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:17:55 2022] DELETE /identity/v3/users/be54b477a89547838262c7f4648c1ce3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:17:55.596254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802006e2-cc95-4cc6-8dc0-e34e021b19b5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.596536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802006e2-cc95-4cc6-8dc0-e34e021b19b5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.596816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802006e2-cc95-4cc6-8dc0-e34e021b19b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.614346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-802006e2-cc95-4cc6-8dc0-e34e021b19b5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:17:55.615566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-802006e2-cc95-4cc6-8dc0-e34e021b19b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:17:55.672844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 775/1508] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:17:55.682859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:55.684278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:17:55.740195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e3170-8b25-45eb-9fea-a23d97cacffb admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:55.743912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be5078-6a97-4cd0-b8c0-51351c454c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:55.744560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5078-6a97-4cd0-b8c0-51351c454c18 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:55.744845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5078-6a97-4cd0-b8c0-51351c454c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:55.745121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be5078-6a97-4cd0-b8c0-51351c454c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:55.753980 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be5078-6a97-4cd0-b8c0-51351c454c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:55.755433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be5078-6a97-4cd0-b8c0-51351c454c18 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:55.764796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 734/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:17:56.092085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802006e2-cc95-4cc6-8dc0-e34e021b19b5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:17:56.093538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-802006e2-cc95-4cc6-8dc0-e34e021b19b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:17:56.106160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802006e2-cc95-4cc6-8dc0-e34e021b19b5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:17:56.111552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:17:56.112388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:17:56.112670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:17:56.112988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] PATH_INFO: `/v3/projects/9a6f62b5a4c64810b8fdfbef6b2f2b36` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:17:56.114118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6f62b5a4c64810b8fdfbef6b2f2b36)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:17:56.115255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING py.warnings [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:17:56.115255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: warnings.warn(msg) Jun 07 14:17:56.115255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: Jun 07 14:17:56.116495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:17:56.175642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6f62b5a4c64810b8fdfbef6b2f2b36', 'request_id': 'req-8851177a-45af-41d0-ba40-84492928aa8c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:56.185022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6f62b5a4c64810b8fdfbef6b2f2b36', 'request_id': 'req-8851177a-45af-41d0-ba40-84492928aa8c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:56.191716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6f62b5a4c64810b8fdfbef6b2f2b36', 'request_id': 'req-8851177a-45af-41d0-ba40-84492928aa8c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:56.210541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] The token cache is being invalidate because project 9a6f62b5a4c64810b8fdfbef6b2f2b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:17:56.210826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:56.211507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8851177a-45af-41d0-ba40-84492928aa8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:17:56.213150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 776/1510] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:17:56 2022] DELETE /identity/v3/projects/9a6f62b5a4c64810b8fdfbef6b2f2b36 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:18:05.760744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:18:06.206878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:19:41.871974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d625f-193d-4972-ab4f-b94090c3a977 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:41.872531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d625f-193d-4972-ab4f-b94090c3a977 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:41.872531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d625f-193d-4972-ab4f-b94090c3a977 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:41.873907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 735/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:41.878748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdf28c-959b-4da3-9ffd-9524f8e4bbb1 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:41.879182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdf28c-959b-4da3-9ffd-9524f8e4bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:41.879312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdf28c-959b-4da3-9ffd-9524f8e4bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:41.897145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8bcdf28c-959b-4da3-9ffd-9524f8e4bbb1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:41.898361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8bcdf28c-959b-4da3-9ffd-9524f8e4bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:41.957777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 777/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:19:42.128985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d625f-193d-4972-ab4f-b94090c3a977 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:42.130673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8b8d625f-193d-4972-ab4f-b94090c3a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:42.208335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d625f-193d-4972-ab4f-b94090c3a977 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:42.213701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1120d-797f-421e-9039-fcbea048b1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:42.214350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1120d-797f-421e-9039-fcbea048b1b6 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:42.215183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1120d-797f-421e-9039-fcbea048b1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:42.215501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1120d-797f-421e-9039-fcbea048b1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:42.223550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1120d-797f-421e-9039-fcbea048b1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:42.225128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1120d-797f-421e-9039-fcbea048b1b6 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:42.235088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 736/1513] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:19:42.929157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9afd0-eb9d-4c91-b989-511ee6323e13 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:42.929731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9afd0-eb9d-4c91-b989-511ee6323e13 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:42.929848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9afd0-eb9d-4c91-b989-511ee6323e13 None None] PATH_INFO: `/v3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:42.931263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 778/1514] 10.222.0.72 () {54 vars in 925 bytes} [Tue Jun 7 14:19:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:19:42.937803 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6aed7-ceab-4ef6-883f-03c74712ad66 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:42.938690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6aed7-ceab-4ef6-883f-03c74712ad66 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:42.938983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6aed7-ceab-4ef6-883f-03c74712ad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:42.957246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-00e6aed7-ceab-4ef6-883f-03c74712ad66 None None] MFA Rules not processed for user `a0cc577feba04e66b950a69b918d4ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:42.958475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-00e6aed7-ceab-4ef6-883f-03c74712ad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:43.021343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 737/1515] 10.222.0.72 () {58 vars in 1015 bytes} [Tue Jun 7 14:19:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:19:43.100654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33202a5-cf3d-4719-8237-bba962a2bd6b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:43.100972 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33202a5-cf3d-4719-8237-bba962a2bd6b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:43.101249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33202a5-cf3d-4719-8237-bba962a2bd6b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:43.102625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 779/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:43.108121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e91078-4c5d-4d6a-b078-3e7bfb929c39 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:43.108414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e91078-4c5d-4d6a-b078-3e7bfb929c39 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:43.108691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e91078-4c5d-4d6a-b078-3e7bfb929c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:43.126467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-68e91078-4c5d-4d6a-b078-3e7bfb929c39 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:43.127729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-68e91078-4c5d-4d6a-b078-3e7bfb929c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:43.135679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 738/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:19:43.294358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33202a5-cf3d-4719-8237-bba962a2bd6b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:43.308440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33202a5-cf3d-4719-8237-bba962a2bd6b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:43.313845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd750d6-122e-4abc-b7ca-0881121d6200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:43.314474 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd750d6-122e-4abc-b7ca-0881121d6200 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:43.314758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd750d6-122e-4abc-b7ca-0881121d6200 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:43.315034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd750d6-122e-4abc-b7ca-0881121d6200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:43.323499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd750d6-122e-4abc-b7ca-0881121d6200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:43.325564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd750d6-122e-4abc-b7ca-0881121d6200 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:43.334938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 780/1518] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:19:46.987778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed977be-fb02-403d-b652-c855a7573517 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:46.988343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed977be-fb02-403d-b652-c855a7573517 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:46.988343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed977be-fb02-403d-b652-c855a7573517 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:46.989710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 739/1519] 10.222.0.77 () {54 vars in 960 bytes} [Tue Jun 7 14:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:46.994916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b990bb-773d-40f2-ac6c-566b28e1ad7f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:46.995324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b990bb-773d-40f2-ac6c-566b28e1ad7f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:46.995580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b990bb-773d-40f2-ac6c-566b28e1ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:47.013598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-33b990bb-773d-40f2-ac6c-566b28e1ad7f None None] MFA Rules not processed for user `a0cc577feba04e66b950a69b918d4ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:47.014774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-33b990bb-773d-40f2-ac6c-566b28e1ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:47.023066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 781/1520] 10.222.0.77 () {58 vars in 1057 bytes} [Tue Jun 7 14:19:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:19:47.030653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed977be-fb02-403d-b652-c855a7573517 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:47.043943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed977be-fb02-403d-b652-c855a7573517 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:47.048866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febba6c3-495f-45ad-81f2-a792aff7b4b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:47.049492 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febba6c3-495f-45ad-81f2-a792aff7b4b6 service placement] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:47.049779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febba6c3-495f-45ad-81f2-a792aff7b4b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:47.050053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febba6c3-495f-45ad-81f2-a792aff7b4b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:47.058418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febba6c3-495f-45ad-81f2-a792aff7b4b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:47.060029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febba6c3-495f-45ad-81f2-a792aff7b4b6 service placement] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:47.069860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 740/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:19:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:19:54.606825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0634c-d1cd-4e57-b5f0-254ff89a1b7a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:54.607426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0634c-d1cd-4e57-b5f0-254ff89a1b7a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:54.607572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0634c-d1cd-4e57-b5f0-254ff89a1b7a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:54.608961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 782/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:54.613715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448426fc-b9b8-40a8-8e6d-1319eebb0f4c None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:54.614140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448426fc-b9b8-40a8-8e6d-1319eebb0f4c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:54.614258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448426fc-b9b8-40a8-8e6d-1319eebb0f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:54.631906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-448426fc-b9b8-40a8-8e6d-1319eebb0f4c None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:54.633097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-448426fc-b9b8-40a8-8e6d-1319eebb0f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:54.641410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 741/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:19:54.794801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0634c-d1cd-4e57-b5f0-254ff89a1b7a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:54.809695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0634c-d1cd-4e57-b5f0-254ff89a1b7a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:54.815017 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4048f2-8b03-4570-be42-755c7335c723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:54.815699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4048f2-8b03-4570-be42-755c7335c723 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:54.815980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4048f2-8b03-4570-be42-755c7335c723 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:54.816256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4048f2-8b03-4570-be42-755c7335c723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:54.825174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4048f2-8b03-4570-be42-755c7335c723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:54.826768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4048f2-8b03-4570-be42-755c7335c723 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:54.836399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 783/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:19:55.693843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b2af9-dcc8-4257-ba7b-fb50d324da59 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:55.694629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b2af9-dcc8-4257-ba7b-fb50d324da59 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:55.694629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b2af9-dcc8-4257-ba7b-fb50d324da59 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:55.696044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 742/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 7 14:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:19:55.700939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e387-21aa-4d07-9624-fac7b4596c96 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:55.701373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e387-21aa-4d07-9624-fac7b4596c96 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:55.701496 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84e387-21aa-4d07-9624-fac7b4596c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:55.719817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8e84e387-21aa-4d07-9624-fac7b4596c96 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:19:55.721011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8e84e387-21aa-4d07-9624-fac7b4596c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:19:55.728755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 784/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 7 14:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:19:55.879386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b2af9-dcc8-4257-ba7b-fb50d324da59 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:19:55.895723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b2af9-dcc8-4257-ba7b-fb50d324da59 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:19:55.901104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6f69-3194-47fa-b789-fbfc162f73a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:19:55.901792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6f69-3194-47fa-b789-fbfc162f73a9 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:19:55.902736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6f69-3194-47fa-b789-fbfc162f73a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:19:55.903009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6f69-3194-47fa-b789-fbfc162f73a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:19:55.911259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6f69-3194-47fa-b789-fbfc162f73a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:19:55.912868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6f69-3194-47fa-b789-fbfc162f73a9 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:19:55.922074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 743/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:20:00.084746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f740163-c3e8-4738-bccc-b4040eb36c8f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:00.085360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f740163-c3e8-4738-bccc-b4040eb36c8f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:00.085360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f740163-c3e8-4738-bccc-b4040eb36c8f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:00.086719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 785/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:00.092491 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8456-e83a-4f2e-a0a6-6767c7913d3e None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:00.092896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8456-e83a-4f2e-a0a6-6767c7913d3e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:00.093054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8456-e83a-4f2e-a0a6-6767c7913d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:00.111288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-562d8456-e83a-4f2e-a0a6-6767c7913d3e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:00.112512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-562d8456-e83a-4f2e-a0a6-6767c7913d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:00.120440 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 744/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:20:00.157318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f740163-c3e8-4738-bccc-b4040eb36c8f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:00.159039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0f740163-c3e8-4738-bccc-b4040eb36c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:00.214755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f740163-c3e8-4738-bccc-b4040eb36c8f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:00.218475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3712f64-4c8d-4650-88a2-0c8180b26f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:00.219116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3712f64-4c8d-4650-88a2-0c8180b26f6e service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:00.219442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3712f64-4c8d-4650-88a2-0c8180b26f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:00.219731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3712f64-4c8d-4650-88a2-0c8180b26f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:00.228825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3712f64-4c8d-4650-88a2-0c8180b26f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:00.230857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3712f64-4c8d-4650-88a2-0c8180b26f6e service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:00.240304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 786/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:20:02.454274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab3a47-22fa-4fde-8bdf-08f84ea88cea None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:02.454841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab3a47-22fa-4fde-8bdf-08f84ea88cea None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:02.454841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab3a47-22fa-4fde-8bdf-08f84ea88cea None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:02.456264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 745/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:02.461484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13682ade-0a08-4ec4-82c3-2b35b55f47ba None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:02.461898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13682ade-0a08-4ec4-82c3-2b35b55f47ba None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:02.462034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13682ade-0a08-4ec4-82c3-2b35b55f47ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:02.479771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-13682ade-0a08-4ec4-82c3-2b35b55f47ba None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:02.480952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-13682ade-0a08-4ec4-82c3-2b35b55f47ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:02.489066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 787/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:20:02.525648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab3a47-22fa-4fde-8bdf-08f84ea88cea None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:02.527427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f9ab3a47-22fa-4fde-8bdf-08f84ea88cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:02.540384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab3a47-22fa-4fde-8bdf-08f84ea88cea None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:02.543993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c7888-062a-48f5-89d2-591a5d338e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:02.544609 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c7888-062a-48f5-89d2-591a5d338e5f service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:02.544895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c7888-062a-48f5-89d2-591a5d338e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:02.545174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c7888-062a-48f5-89d2-591a5d338e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:02.554046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c7888-062a-48f5-89d2-591a5d338e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:02.555537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c7888-062a-48f5-89d2-591a5d338e5f service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:02.565483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 746/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:20:06.286026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c196cfe-92f0-4e43-b080-f7f21daa7f24 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:06.286584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c196cfe-92f0-4e43-b080-f7f21daa7f24 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:06.286584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c196cfe-92f0-4e43-b080-f7f21daa7f24 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:06.287907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 788/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:06.293730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ca77-0ba3-4c26-9144-6ca987a8a897 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:06.294185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ca77-0ba3-4c26-9144-6ca987a8a897 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:06.294293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725ca77-0ba3-4c26-9144-6ca987a8a897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:06.300644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=91 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:06.314021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6725ca77-0ba3-4c26-9144-6ca987a8a897 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:06.315258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6725ca77-0ba3-4c26-9144-6ca987a8a897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:06.323392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 747/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:20:06.595312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c196cfe-92f0-4e43-b080-f7f21daa7f24 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:06.597013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5c196cfe-92f0-4e43-b080-f7f21daa7f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:06.602755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=75 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:06.654288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c196cfe-92f0-4e43-b080-f7f21daa7f24 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:06.657855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7852571-fa1b-4dbb-965b-af77d19c632f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:06.658492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7852571-fa1b-4dbb-965b-af77d19c632f service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:06.658775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7852571-fa1b-4dbb-965b-af77d19c632f service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:06.659051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7852571-fa1b-4dbb-965b-af77d19c632f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:06.667833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7852571-fa1b-4dbb-965b-af77d19c632f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:06.669235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7852571-fa1b-4dbb-965b-af77d19c632f service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:06.678560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 789/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:20:08.928550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b803b9-735d-4cfd-b6a2-0d79c3a59cfa None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.929105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b803b9-735d-4cfd-b6a2-0d79c3a59cfa None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.929105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b803b9-735d-4cfd-b6a2-0d79c3a59cfa None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.930497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 748/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 7 14:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:20:08.936428 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c722d-af97-414b-b3d4-d3d7e0afe088 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:08.936882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c722d-af97-414b-b3d4-d3d7e0afe088 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:08.937000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c722d-af97-414b-b3d4-d3d7e0afe088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:08.954994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7a1c722d-af97-414b-b3d4-d3d7e0afe088 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:20:08.956209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7a1c722d-af97-414b-b3d4-d3d7e0afe088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:08.963908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 790/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 7 14:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:20:09.232607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b803b9-735d-4cfd-b6a2-0d79c3a59cfa None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:20:09.234294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e2b803b9-735d-4cfd-b6a2-0d79c3a59cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:20:09.247195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b803b9-735d-4cfd-b6a2-0d79c3a59cfa None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:20:09.250716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837225a-ab56-4cba-8ee4-af9127767ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:20:09.251384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837225a-ab56-4cba-8ee4-af9127767ddd service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:20:09.251674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837225a-ab56-4cba-8ee4-af9127767ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:20:09.251950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837225a-ab56-4cba-8ee4-af9127767ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:20:09.260625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837225a-ab56-4cba-8ee4-af9127767ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:20:09.262044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837225a-ab56-4cba-8ee4-af9127767ddd service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:20:09.273011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 749/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:20:18.949832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=28 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:20:19.268971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=8 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:44.921913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d537bc-e3d6-4cf7-b839-b331b25ccaa7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:44.922540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d537bc-e3d6-4cf7-b839-b331b25ccaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:44.922540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d537bc-e3d6-4cf7-b839-b331b25ccaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:44.955210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d2d537bc-e3d6-4cf7-b839-b331b25ccaa7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:44.956693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d2d537bc-e3d6-4cf7-b839-b331b25ccaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:44.965573 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 791/1540] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:44.979537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f97b99-3ed9-41b2-9776-71695336b16b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:44.980129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f97b99-3ed9-41b2-9776-71695336b16b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:44.980129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f97b99-3ed9-41b2-9776-71695336b16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.007082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d6f97b99-3ed9-41b2-9776-71695336b16b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.008672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d6f97b99-3ed9-41b2-9776-71695336b16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.018353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 750/1541] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:45.023228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d537bc-e3d6-4cf7-b839-b331b25ccaa7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.034312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d537bc-e3d6-4cf7-b839-b331b25ccaa7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.042530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939691b-99e4-4383-97ff-5bc8dd060a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.043222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939691b-99e4-4383-97ff-5bc8dd060a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.043580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939691b-99e4-4383-97ff-5bc8dd060a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.043860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939691b-99e4-4383-97ff-5bc8dd060a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.044609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939691b-99e4-4383-97ff-5bc8dd060a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:45.044917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939691b-99e4-4383-97ff-5bc8dd060a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.046698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939691b-99e4-4383-97ff-5bc8dd060a38 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.061891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 792/1542] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:45.070670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f97b99-3ed9-41b2-9776-71695336b16b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.084938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f97b99-3ed9-41b2-9776-71695336b16b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.090433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a89bd8-74dc-4227-84dc-4fb01658e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.091147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a89bd8-74dc-4227-84dc-4fb01658e91d admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.091468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a89bd8-74dc-4227-84dc-4fb01658e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.091753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a89bd8-74dc-4227-84dc-4fb01658e91d admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.092490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a89bd8-74dc-4227-84dc-4fb01658e91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.094447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a89bd8-74dc-4227-84dc-4fb01658e91d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.134244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 751/1543] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:45.139023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939691b-99e4-4383-97ff-5bc8dd060a38 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.149899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939691b-99e4-4383-97ff-5bc8dd060a38 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.226337 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671ed40-c54e-4c4f-917e-0a938efa6f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.226951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671ed40-c54e-4c4f-917e-0a938efa6f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.227241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671ed40-c54e-4c4f-917e-0a938efa6f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.227553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671ed40-c54e-4c4f-917e-0a938efa6f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.228723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671ed40-c54e-4c4f-917e-0a938efa6f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.230672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671ed40-c54e-4c4f-917e-0a938efa6f88 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.270687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 793/1544] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:45.274625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a89bd8-74dc-4227-84dc-4fb01658e91d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.286213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a89bd8-74dc-4227-84dc-4fb01658e91d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.295034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b9c6-0685-4034-bca9-71b59233373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.295746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b9c6-0685-4034-bca9-71b59233373f admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.296036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b9c6-0685-4034-bca9-71b59233373f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.296314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b9c6-0685-4034-bca9-71b59233373f admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.297060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301b9c6-0685-4034-bca9-71b59233373f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.298664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301b9c6-0685-4034-bca9-71b59233373f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.311448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 752/1545] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:45.315237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671ed40-c54e-4c4f-917e-0a938efa6f88 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.326660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671ed40-c54e-4c4f-917e-0a938efa6f88 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.334966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1c042-62ac-40d5-866d-a0924375755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.335694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1c042-62ac-40d5-866d-a0924375755c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.335983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1c042-62ac-40d5-866d-a0924375755c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.336266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1c042-62ac-40d5-866d-a0924375755c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.337020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1c042-62ac-40d5-866d-a0924375755c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.338636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1c042-62ac-40d5-866d-a0924375755c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.352051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 794/1546] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:45.357031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b9c6-0685-4034-bca9-71b59233373f admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.371283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b9c6-0685-4034-bca9-71b59233373f admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.384519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d47737-a724-4d55-a28f-836c5983deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.385443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47737-a724-4d55-a28f-836c5983deee admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.385730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47737-a724-4d55-a28f-836c5983deee admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.386008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47737-a724-4d55-a28f-836c5983deee admin admin] PATH_INFO: `/v3/projects/2ac2989dcedc44549622cf3fc3099c96/users/dbb724c94786403994ca6f31ec2a17d0/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.408743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47737-a724-4d55-a28f-836c5983deee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac2989dcedc44549622cf3fc3099c96, user_id=dbb724c94786403994ca6f31ec2a17d0, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.411432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47737-a724-4d55-a28f-836c5983deee admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.427129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31963b5c-56d1-4655-b45d-9f5e1f482e17 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.427624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31963b5c-56d1-4655-b45d-9f5e1f482e17 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.427755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31963b5c-56d1-4655-b45d-9f5e1f482e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.460044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 753/1547] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:45 2022] PUT /identity/v3/projects/2ac2989dcedc44549622cf3fc3099c96/users/dbb724c94786403994ca6f31ec2a17d0/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:45.476232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-31963b5c-56d1-4655-b45d-9f5e1f482e17 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.485115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc26a-b9be-4b28-851d-48aa7e7fcbc9 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.485310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc26a-b9be-4b28-851d-48aa7e7fcbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.485593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc26a-b9be-4b28-851d-48aa7e7fcbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.501768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-31963b5c-56d1-4655-b45d-9f5e1f482e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.563362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-dbadc26a-b9be-4b28-851d-48aa7e7fcbc9 None None] MFA Rules not processed for user `dbb724c94786403994ca6f31ec2a17d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.563362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-dbadc26a-b9be-4b28-851d-48aa7e7fcbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.710288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 754/1548] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:45.710488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 795/1549] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:45.711436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa0824-e9fe-4ac6-be33-988d27c3de9a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.711735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa0824-e9fe-4ac6-be33-988d27c3de9a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.711854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d2b4-6029-4055-bcce-6826a424f08d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.712028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa0824-e9fe-4ac6-be33-988d27c3de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.712129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d2b4-6029-4055-bcce-6826a424f08d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.712296 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372d2b4-6029-4055-bcce-6826a424f08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.740291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-bcfa0824-e9fe-4ac6-be33-988d27c3de9a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.741424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-bcfa0824-e9fe-4ac6-be33-988d27c3de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.753125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e372d2b4-6029-4055-bcce-6826a424f08d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.754436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e372d2b4-6029-4055-bcce-6826a424f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.782413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 755/1550] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:45.791796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 796/1551] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:45.792487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d2b4-6029-4055-bcce-6826a424f08d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:45.796144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce8b92-d8ad-41c6-a7cb-8a1d5a17d72d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.796144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce8b92-d8ad-41c6-a7cb-8a1d5a17d72d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.796144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce8b92-d8ad-41c6-a7cb-8a1d5a17d72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.824078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372d2b4-6029-4055-bcce-6826a424f08d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:45.826500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-22ce8b92-d8ad-41c6-a7cb-8a1d5a17d72d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.827753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-22ce8b92-d8ad-41c6-a7cb-8a1d5a17d72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.828726 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602a984-a749-4f92-90ad-77edb7b97587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:45.829388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602a984-a749-4f92-90ad-77edb7b97587 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.829668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602a984-a749-4f92-90ad-77edb7b97587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.830062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602a984-a749-4f92-90ad-77edb7b97587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.830790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602a984-a749-4f92-90ad-77edb7b97587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:45.831853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING py.warnings [None req-d602a984-a749-4f92-90ad-77edb7b97587 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:21:45.831853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: warnings.warn(msg) Jun 07 14:21:45.831853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: Jun 07 14:21:45.833035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602a984-a749-4f92-90ad-77edb7b97587 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:45.836385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 756/1552] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:45.837731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b53f-498b-40d0-8e80-1678fe8de584 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.838072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b53f-498b-40d0-8e80-1678fe8de584 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.838422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b53f-498b-40d0-8e80-1678fe8de584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.861543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-db62b53f-498b-40d0-8e80-1678fe8de584 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.862828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-db62b53f-498b-40d0-8e80-1678fe8de584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.871132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 757/1553] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:45.875083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810668-91ad-419a-89e1-5854b0321bb3 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.875083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810668-91ad-419a-89e1-5854b0321bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.875083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2810668-91ad-419a-89e1-5854b0321bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.877175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 797/1554] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:45.878511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81162199-878c-4ccf-9bd0-5a678a04cb47 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.878828 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81162199-878c-4ccf-9bd0-5a678a04cb47 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.879102 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81162199-878c-4ccf-9bd0-5a678a04cb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.893359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b2810668-91ad-419a-89e1-5854b0321bb3 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.894576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b2810668-91ad-419a-89e1-5854b0321bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.904863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-81162199-878c-4ccf-9bd0-5a678a04cb47 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.906047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-81162199-878c-4ccf-9bd0-5a678a04cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.941891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.966507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 758/1555] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:45.967853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6c296-189d-4c9c-88d3-206c73675002 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.968140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6c296-189d-4c9c-88d3-206c73675002 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.968414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6c296-189d-4c9c-88d3-206c73675002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.980118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:45.982518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 798/1556] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:45.983870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fd5b7-57f1-4bc7-8565-57085e558902 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:45.984159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fd5b7-57f1-4bc7-8565-57085e558902 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:45.984448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fd5b7-57f1-4bc7-8565-57085e558902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:45.989926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8ac6c296-189d-4c9c-88d3-206c73675002 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:45.991216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8ac6c296-189d-4c9c-88d3-206c73675002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:45.999063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 759/1557] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:46.000311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ca1b5-9767-4e42-a87d-696aa9e43c65 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.000593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ca1b5-9767-4e42-a87d-696aa9e43c65 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.000871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ca1b5-9767-4e42-a87d-696aa9e43c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.002762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e10fd5b7-57f1-4bc7-8565-57085e558902 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:46.004060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e10fd5b7-57f1-4bc7-8565-57085e558902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:46.012968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 799/1558] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:46.014203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe8a35-ade9-4881-a3c7-da83ae7dab39 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.014487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe8a35-ade9-4881-a3c7-da83ae7dab39 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.014765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe8a35-ade9-4881-a3c7-da83ae7dab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.021515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e76ca1b5-9767-4e42-a87d-696aa9e43c65 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:46.022778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e76ca1b5-9767-4e42-a87d-696aa9e43c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:46.031418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 760/1559] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:46.032092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ca1b5-9767-4e42-a87d-696aa9e43c65 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.032939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-aafe8a35-ade9-4881-a3c7-da83ae7dab39 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:46.034106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-aafe8a35-ade9-4881-a3c7-da83ae7dab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:46.041082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ca1b5-9767-4e42-a87d-696aa9e43c65 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.042042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 800/1560] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:46.042809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe8a35-ade9-4881-a3c7-da83ae7dab39 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.046899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.047720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.048005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.048913 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.049130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.049441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.050456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WARNING py.warnings [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:21:46.050456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: warnings.warn(msg) Jun 07 14:21:46.050456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: Jun 07 14:21:46.051355 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.052691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe8a35-ade9-4881-a3c7-da83ae7dab39 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.058135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76aa0f-2375-4687-a4e3-b2e8c210678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.058796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76aa0f-2375-4687-a4e3-b2e8c210678e admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.059248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76aa0f-2375-4687-a4e3-b2e8c210678e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.059567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76aa0f-2375-4687-a4e3-b2e8c210678e admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.060283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76aa0f-2375-4687-a4e3-b2e8c210678e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.062171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76aa0f-2375-4687-a4e3-b2e8c210678e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.063484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 761/1561] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:46.064363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.076591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d8a98-810c-4f45-91bf-531d9beef8fc admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.082066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a30804-5563-4f79-8fac-a605c007c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.082793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a30804-5563-4f79-8fac-a605c007c2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.083075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a30804-5563-4f79-8fac-a605c007c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.083374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a30804-5563-4f79-8fac-a605c007c2fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.084097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a30804-5563-4f79-8fac-a605c007c2fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.084430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a30804-5563-4f79-8fac-a605c007c2fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.086031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a30804-5563-4f79-8fac-a605c007c2fd admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.086829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 801/1562] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.087682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76aa0f-2375-4687-a4e3-b2e8c210678e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.097663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76aa0f-2375-4687-a4e3-b2e8c210678e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.105287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 762/1563] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:46.105460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736044a1-d769-46d4-914b-725875302a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.105460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736044a1-d769-46d4-914b-725875302a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.105676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079c64f-b764-4541-9f45-ef5a5f0bad0e None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.105792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736044a1-d769-46d4-914b-725875302a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.105896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079c64f-b764-4541-9f45-ef5a5f0bad0e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.105992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736044a1-d769-46d4-914b-725875302a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.106104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079c64f-b764-4541-9f45-ef5a5f0bad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.106194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736044a1-d769-46d4-914b-725875302a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.106194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736044a1-d769-46d4-914b-725875302a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.106423 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736044a1-d769-46d4-914b-725875302a04 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.125702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 802/1564] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:46.125702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1368b-2531-4d4d-b02c-1f5870a91e97 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.125702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1368b-2531-4d4d-b02c-1f5870a91e97 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.125702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1368b-2531-4d4d-b02c-1f5870a91e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.126164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-5079c64f-b764-4541-9f45-ef5a5f0bad0e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:46.126164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5079c64f-b764-4541-9f45-ef5a5f0bad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:46.132511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 763/1565] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:46.133278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079c64f-b764-4541-9f45-ef5a5f0bad0e None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.138285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d4d1368b-2531-4d4d-b02c-1f5870a91e97 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:46.139506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d4d1368b-2531-4d4d-b02c-1f5870a91e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:46.143783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079c64f-b764-4541-9f45-ef5a5f0bad0e None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.147277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 803/1566] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:46.148375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc52f-bfc1-4d41-8f33-ec2341c7d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.148508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a83bd-15e2-4981-a5a1-e15a313fd61d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.148777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a83bd-15e2-4981-a5a1-e15a313fd61d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.149023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc52f-bfc1-4d41-8f33-ec2341c7d429 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.149119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a83bd-15e2-4981-a5a1-e15a313fd61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.149308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc52f-bfc1-4d41-8f33-ec2341c7d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.149586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc52f-bfc1-4d41-8f33-ec2341c7d429 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.150319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc52f-bfc1-4d41-8f33-ec2341c7d429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.150672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc52f-bfc1-4d41-8f33-ec2341c7d429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.152471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc52f-bfc1-4d41-8f33-ec2341c7d429 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.166560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 764/1567] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:46.167196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0e8a83bd-15e2-4981-a5a1-e15a313fd61d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:46.167380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc52f-bfc1-4d41-8f33-ec2341c7d429 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.168542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0e8a83bd-15e2-4981-a5a1-e15a313fd61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:46.176536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 804/1568] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:46.177303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a83bd-15e2-4981-a5a1-e15a313fd61d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.178421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc52f-bfc1-4d41-8f33-ec2341c7d429 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.183223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52c29e-1ae1-4ef0-a093-de2569860e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.183955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52c29e-1ae1-4ef0-a093-de2569860e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.184424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52c29e-1ae1-4ef0-a093-de2569860e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.184729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52c29e-1ae1-4ef0-a093-de2569860e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.185424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52c29e-1ae1-4ef0-a093-de2569860e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.187313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52c29e-1ae1-4ef0-a093-de2569860e76 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.188967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a83bd-15e2-4981-a5a1-e15a313fd61d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.193517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fbfee-ddc7-4d43-a38f-1d01b7981eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.194162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fbfee-ddc7-4d43-a38f-1d01b7981eae admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.194451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fbfee-ddc7-4d43-a38f-1d01b7981eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.194729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fbfee-ddc7-4d43-a38f-1d01b7981eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.195758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fbfee-ddc7-4d43-a38f-1d01b7981eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.197326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fbfee-ddc7-4d43-a38f-1d01b7981eae admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.209579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 805/1569] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:46.210367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fbfee-ddc7-4d43-a38f-1d01b7981eae admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.214878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 765/1570] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.216541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52c29e-1ae1-4ef0-a093-de2569860e76 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.220915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fbfee-ddc7-4d43-a38f-1d01b7981eae admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.276453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a106e9-e204-492e-8f36-0a44f665fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.277040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a106e9-e204-492e-8f36-0a44f665fd62 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.277327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a106e9-e204-492e-8f36-0a44f665fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.277604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a106e9-e204-492e-8f36-0a44f665fd62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.278865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a106e9-e204-492e-8f36-0a44f665fd62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.278987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52c29e-1ae1-4ef0-a093-de2569860e76 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.280784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a106e9-e204-492e-8f36-0a44f665fd62 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.283392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee70ce7-ca2c-4c95-babd-02c3da2ebd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.284051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee70ce7-ca2c-4c95-babd-02c3da2ebd5e admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.284333 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee70ce7-ca2c-4c95-babd-02c3da2ebd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.284619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee70ce7-ca2c-4c95-babd-02c3da2ebd5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.285297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee70ce7-ca2c-4c95-babd-02c3da2ebd5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.287178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee70ce7-ca2c-4c95-babd-02c3da2ebd5e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.305774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 806/1571] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.306565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a106e9-e204-492e-8f36-0a44f665fd62 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.315919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 766/1572] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.319842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee70ce7-ca2c-4c95-babd-02c3da2ebd5e admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.358340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.372511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a106e9-e204-492e-8f36-0a44f665fd62 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.382503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee70ce7-ca2c-4c95-babd-02c3da2ebd5e admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.389357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d142e-e6b8-4ff3-a7f2-8051e9292b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.390127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d142e-e6b8-4ff3-a7f2-8051e9292b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.390437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d142e-e6b8-4ff3-a7f2-8051e9292b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.390708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d142e-e6b8-4ff3-a7f2-8051e9292b81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.391517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d142e-e6b8-4ff3-a7f2-8051e9292b81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.391827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d142e-e6b8-4ff3-a7f2-8051e9292b81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.393470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d142e-e6b8-4ff3-a7f2-8051e9292b81 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.405416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 767/1573] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:46.406189 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d142e-e6b8-4ff3-a7f2-8051e9292b81 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.413831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.417985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d142e-e6b8-4ff3-a7f2-8051e9292b81 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.423506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653a05d-fffb-4c54-9ef3-858065a9c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.424347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653a05d-fffb-4c54-9ef3-858065a9c323 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.424630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653a05d-fffb-4c54-9ef3-858065a9c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.424904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653a05d-fffb-4c54-9ef3-858065a9c323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.425613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653a05d-fffb-4c54-9ef3-858065a9c323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.427518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653a05d-fffb-4c54-9ef3-858065a9c323 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.438628 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd30e-9de9-4f9c-938c-fcd72f31eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.439297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd30e-9de9-4f9c-938c-fcd72f31eab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.439609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd30e-9de9-4f9c-938c-fcd72f31eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.439885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd30e-9de9-4f9c-938c-fcd72f31eab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.440699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdd30e-9de9-4f9c-938c-fcd72f31eab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.441006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdd30e-9de9-4f9c-938c-fcd72f31eab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.442591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdd30e-9de9-4f9c-938c-fcd72f31eab4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.455411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 768/1574] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.456020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 807/1575] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:46.463530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653a05d-fffb-4c54-9ef3-858065a9c323 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.463673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd30e-9de9-4f9c-938c-fcd72f31eab4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.472123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd30e-9de9-4f9c-938c-fcd72f31eab4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.527405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653a05d-fffb-4c54-9ef3-858065a9c323 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.532035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70c96-619d-4369-aad5-c2fa0731925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.532698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70c96-619d-4369-aad5-c2fa0731925a admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.532990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70c96-619d-4369-aad5-c2fa0731925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.533269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b70c96-619d-4369-aad5-c2fa0731925a admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.534000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70c96-619d-4369-aad5-c2fa0731925a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:46.534309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70c96-619d-4369-aad5-c2fa0731925a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.534822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b8c18-a063-43d5-a506-d6d8d4a8991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.535766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b8c18-a063-43d5-a506-d6d8d4a8991b admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.535937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b70c96-619d-4369-aad5-c2fa0731925a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.536049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b8c18-a063-43d5-a506-d6d8d4a8991b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.536333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b8c18-a063-43d5-a506-d6d8d4a8991b admin admin] PATH_INFO: `/v3/projects/549ff6b360a3462ca1fa0d83658a4c33/users/b765ef82028e4ff29c0986768595aa32/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.547868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 769/1576] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:46.548646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70c96-619d-4369-aad5-c2fa0731925a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.554004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b8c18-a063-43d5-a506-d6d8d4a8991b admin admin] RBAC: Authorizing `identity:create_grant(project_id=549ff6b360a3462ca1fa0d83658a4c33, user_id=b765ef82028e4ff29c0986768595aa32, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.555041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING py.warnings [None req-fd5b8c18-a063-43d5-a506-d6d8d4a8991b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:21:46.555041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: warnings.warn(msg) Jun 07 14:21:46.555041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: Jun 07 14:21:46.557054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b8c18-a063-43d5-a506-d6d8d4a8991b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.558032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b70c96-619d-4369-aad5-c2fa0731925a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.563479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f282-dd2c-48c9-883a-f3c82c269613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.564246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f282-dd2c-48c9-883a-f3c82c269613 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.564530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f282-dd2c-48c9-883a-f3c82c269613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.564808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f282-dd2c-48c9-883a-f3c82c269613 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.565501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f282-dd2c-48c9-883a-f3c82c269613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.566597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WARNING py.warnings [None req-6711f282-dd2c-48c9-883a-f3c82c269613 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:21:46.566597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: warnings.warn(msg) Jun 07 14:21:46.566597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: Jun 07 14:21:46.567816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f282-dd2c-48c9-883a-f3c82c269613 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.571952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 808/1577] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:46 2022] PUT /identity/v3/projects/549ff6b360a3462ca1fa0d83658a4c33/users/b765ef82028e4ff29c0986768595aa32/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:46.572743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b8c18-a063-43d5-a506-d6d8d4a8991b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.591728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 770/1578] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.591728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f282-dd2c-48c9-883a-f3c82c269613 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.599118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f282-dd2c-48c9-883a-f3c82c269613 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.635050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b8c18-a063-43d5-a506-d6d8d4a8991b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.640278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506734-412b-4cc7-8903-b4cbf6fec0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.640948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506734-412b-4cc7-8903-b4cbf6fec0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.641233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506734-412b-4cc7-8903-b4cbf6fec0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.641510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506734-412b-4cc7-8903-b4cbf6fec0fe admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.642194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d506734-412b-4cc7-8903-b4cbf6fec0fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.644139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d506734-412b-4cc7-8903-b4cbf6fec0fe admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.655981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ec319-f446-4ae4-a7ca-75b323af0e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.656655 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec319-f446-4ae4-a7ca-75b323af0e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.656944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec319-f446-4ae4-a7ca-75b323af0e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.657226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec319-f446-4ae4-a7ca-75b323af0e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.657911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ec319-f446-4ae4-a7ca-75b323af0e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.659918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ec319-f446-4ae4-a7ca-75b323af0e4c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.664158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 809/1579] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.664948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506734-412b-4cc7-8903-b4cbf6fec0fe admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.669884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.674870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506734-412b-4cc7-8903-b4cbf6fec0fe admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.680015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 771/1580] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.681026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ec319-f446-4ae4-a7ca-75b323af0e4c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.681237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e66d86-b0d9-4ce9-a2c3-98995265d17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.682024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e66d86-b0d9-4ce9-a2c3-98995265d17d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.682311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e66d86-b0d9-4ce9-a2c3-98995265d17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.682600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e66d86-b0d9-4ce9-a2c3-98995265d17d admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.683454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e66d86-b0d9-4ce9-a2c3-98995265d17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.686045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e66d86-b0d9-4ce9-a2c3-98995265d17d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.691531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ec319-f446-4ae4-a7ca-75b323af0e4c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.696382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf9362-aa48-49f0-915a-00ba8202a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.697029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9362-aa48-49f0-915a-00ba8202a256 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.697309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9362-aa48-49f0-915a-00ba8202a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.697646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9362-aa48-49f0-915a-00ba8202a256 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.698326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf9362-aa48-49f0-915a-00ba8202a256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.700833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf9362-aa48-49f0-915a-00ba8202a256 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.716191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 810/1581] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.717041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e66d86-b0d9-4ce9-a2c3-98995265d17d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.723406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 772/1582] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.726580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf9362-aa48-49f0-915a-00ba8202a256 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.736188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf9362-aa48-49f0-915a-00ba8202a256 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.765580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.780771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e66d86-b0d9-4ce9-a2c3-98995265d17d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.785241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf786f8-4c73-45a9-b2c7-d984bb66b045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.785900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf786f8-4c73-45a9-b2c7-d984bb66b045 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.786183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf786f8-4c73-45a9-b2c7-d984bb66b045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.786456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf786f8-4c73-45a9-b2c7-d984bb66b045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.787134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf786f8-4c73-45a9-b2c7-d984bb66b045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.789055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf786f8-4c73-45a9-b2c7-d984bb66b045 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.795271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b687-1bb4-41cd-b6b2-61874bd01850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.795968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b687-1bb4-41cd-b6b2-61874bd01850 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.796253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b687-1bb4-41cd-b6b2-61874bd01850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.796533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b687-1bb4-41cd-b6b2-61874bd01850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.797215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301b687-1bb4-41cd-b6b2-61874bd01850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.799108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301b687-1bb4-41cd-b6b2-61874bd01850 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.815450 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 811/1583] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.819097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf786f8-4c73-45a9-b2c7-d984bb66b045 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.827123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 773/1584] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:46.827844 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b687-1bb4-41cd-b6b2-61874bd01850 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.879871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf786f8-4c73-45a9-b2c7-d984bb66b045 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.891805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b687-1bb4-41cd-b6b2-61874bd01850 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.896823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f22d2-5335-4911-8928-7695952464d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.897529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f22d2-5335-4911-8928-7695952464d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.897820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f22d2-5335-4911-8928-7695952464d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.898099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f22d2-5335-4911-8928-7695952464d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.898832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f22d2-5335-4911-8928-7695952464d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.900455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f22d2-5335-4911-8928-7695952464d5 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.910832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 774/1585] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:46.912006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f22d2-5335-4911-8928-7695952464d5 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.922529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f22d2-5335-4911-8928-7695952464d5 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.927685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62251f-dfb6-440f-87dd-2708d9d75ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.928344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62251f-dfb6-440f-87dd-2708d9d75ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.928630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62251f-dfb6-440f-87dd-2708d9d75ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.928910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62251f-dfb6-440f-87dd-2708d9d75ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.929715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62251f-dfb6-440f-87dd-2708d9d75ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.931328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62251f-dfb6-440f-87dd-2708d9d75ed2 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.939067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988ce6c-9993-4df2-8f64-ad9a6444c62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.939847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988ce6c-9993-4df2-8f64-ad9a6444c62e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.940128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988ce6c-9993-4df2-8f64-ad9a6444c62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.940403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988ce6c-9993-4df2-8f64-ad9a6444c62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.941160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988ce6c-9993-4df2-8f64-ad9a6444c62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.942226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 775/1586] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:46.943026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62251f-dfb6-440f-87dd-2708d9d75ed2 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.946289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988ce6c-9993-4df2-8f64-ad9a6444c62e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.952718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62251f-dfb6-440f-87dd-2708d9d75ed2 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.959309 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 812/1587] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:46.959309 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988ce6c-9993-4df2-8f64-ad9a6444c62e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.959583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed552906-d2f8-4804-a4e9-806baf9b9af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.959583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed552906-d2f8-4804-a4e9-806baf9b9af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.959583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed552906-d2f8-4804-a4e9-806baf9b9af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.959583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed552906-d2f8-4804-a4e9-806baf9b9af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.959952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed552906-d2f8-4804-a4e9-806baf9b9af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.961245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed552906-d2f8-4804-a4e9-806baf9b9af2 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.966978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988ce6c-9993-4df2-8f64-ad9a6444c62e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.971730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ca6e-02f8-47b8-a752-e0e8e7d9687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.974865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 776/1588] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:46.975005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ca6e-02f8-47b8-a752-e0e8e7d9687b admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.975005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ca6e-02f8-47b8-a752-e0e8e7d9687b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.975005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ca6e-02f8-47b8-a752-e0e8e7d9687b admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.975277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed552906-d2f8-4804-a4e9-806baf9b9af2 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:46.975425 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ca6e-02f8-47b8-a752-e0e8e7d9687b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.975564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ca6e-02f8-47b8-a752-e0e8e7d9687b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:46.982877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed552906-d2f8-4804-a4e9-806baf9b9af2 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:46.983769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:46.989597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ee7a2-9500-4af5-b6fd-d025c3e020e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:46.990550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ee7a2-9500-4af5-b6fd-d025c3e020e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:46.990550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ee7a2-9500-4af5-b6fd-d025c3e020e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:46.990876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ee7a2-9500-4af5-b6fd-d025c3e020e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:46.991911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ee7a2-9500-4af5-b6fd-d025c3e020e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:46.993498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ee7a2-9500-4af5-b6fd-d025c3e020e2 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.000645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 813/1589] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:47.000645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ca6e-02f8-47b8-a752-e0e8e7d9687b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.008904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 777/1590] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.008904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ee7a2-9500-4af5-b6fd-d025c3e020e2 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.009165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ca6e-02f8-47b8-a752-e0e8e7d9687b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.012791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49100385-32c3-4040-a1f6-7514f3816851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.013442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49100385-32c3-4040-a1f6-7514f3816851 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.013721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49100385-32c3-4040-a1f6-7514f3816851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.013997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49100385-32c3-4040-a1f6-7514f3816851 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.014686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49100385-32c3-4040-a1f6-7514f3816851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.016610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49100385-32c3-4040-a1f6-7514f3816851 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.016729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ee7a2-9500-4af5-b6fd-d025c3e020e2 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.021294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a5f68-34ad-4546-a502-86263918ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.021932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a5f68-34ad-4546-a502-86263918ac9c admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.022217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a5f68-34ad-4546-a502-86263918ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.022498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a5f68-34ad-4546-a502-86263918ac9c admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.023207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a5f68-34ad-4546-a502-86263918ac9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.025129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a5f68-34ad-4546-a502-86263918ac9c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.037934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 814/1591] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:46 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:47.042144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49100385-32c3-4040-a1f6-7514f3816851 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.047159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 778/1592] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:47 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:47.048023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a5f68-34ad-4546-a502-86263918ac9c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.052604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49100385-32c3-4040-a1f6-7514f3816851 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.057179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965a6e3-0b79-4b6f-b553-f76d388dc9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.057343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a5f68-34ad-4546-a502-86263918ac9c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.057834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a6e3-0b79-4b6f-b553-f76d388dc9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.058117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a6e3-0b79-4b6f-b553-f76d388dc9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.058395 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965a6e3-0b79-4b6f-b553-f76d388dc9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.059736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965a6e3-0b79-4b6f-b553-f76d388dc9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.061312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965a6e3-0b79-4b6f-b553-f76d388dc9a8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.062570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9e490-7624-48f3-b4f3-4dec88cc9cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.063217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9e490-7624-48f3-b4f3-4dec88cc9cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.063535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9e490-7624-48f3-b4f3-4dec88cc9cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.063811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9e490-7624-48f3-b4f3-4dec88cc9cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.064561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9e490-7624-48f3-b4f3-4dec88cc9cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.066133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9e490-7624-48f3-b4f3-4dec88cc9cfe admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.072469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 815/1593] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.073715 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965a6e3-0b79-4b6f-b553-f76d388dc9a8 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.076985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 779/1594] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.077807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9e490-7624-48f3-b4f3-4dec88cc9cfe admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.085032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965a6e3-0b79-4b6f-b553-f76d388dc9a8 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.087542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9e490-7624-48f3-b4f3-4dec88cc9cfe admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.089899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cc5b6-2e31-4e61-8e00-bd3c4aae0c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.090774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cc5b6-2e31-4e61-8e00-bd3c4aae0c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.091052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cc5b6-2e31-4e61-8e00-bd3c4aae0c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.091329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cc5b6-2e31-4e61-8e00-bd3c4aae0c5c admin admin] PATH_INFO: `/v3/projects/549ff6b360a3462ca1fa0d83658a4c33/users/b765ef82028e4ff29c0986768595aa32/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.092152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c65c2-6a01-4a7f-867d-8fdd3d57f0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.092860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c65c2-6a01-4a7f-867d-8fdd3d57f0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.093145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c65c2-6a01-4a7f-867d-8fdd3d57f0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.093315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cc5b6-2e31-4e61-8e00-bd3c4aae0c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=549ff6b360a3462ca1fa0d83658a4c33, user_id=b765ef82028e4ff29c0986768595aa32, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.093426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c65c2-6a01-4a7f-867d-8fdd3d57f0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.094139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c65c2-6a01-4a7f-867d-8fdd3d57f0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.095804 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c65c2-6a01-4a7f-867d-8fdd3d57f0ad admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.096064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cc5b6-2e31-4e61-8e00-bd3c4aae0c5c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.106529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 780/1595] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.115465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 816/1596] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:47 2022] PUT /identity/v3/projects/549ff6b360a3462ca1fa0d83658a4c33/users/b765ef82028e4ff29c0986768595aa32/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:47.115625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c65c2-6a01-4a7f-867d-8fdd3d57f0ad admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.115720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cc5b6-2e31-4e61-8e00-bd3c4aae0c5c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.119969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c65c2-6a01-4a7f-867d-8fdd3d57f0ad admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.161207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:47.180356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cc5b6-2e31-4e61-8e00-bd3c4aae0c5c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.181686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab351ec-5192-498d-a349-8972506cc4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.182370 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab351ec-5192-498d-a349-8972506cc4ce admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.182657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab351ec-5192-498d-a349-8972506cc4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.182940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab351ec-5192-498d-a349-8972506cc4ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.183714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab351ec-5192-498d-a349-8972506cc4ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.185248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e25c8a-7121-45c0-9833-b3f3253cf4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.185407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab351ec-5192-498d-a349-8972506cc4ce admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.185939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e25c8a-7121-45c0-9833-b3f3253cf4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.186223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e25c8a-7121-45c0-9833-b3f3253cf4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.186676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e25c8a-7121-45c0-9833-b3f3253cf4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.187854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e25c8a-7121-45c0-9833-b3f3253cf4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.189755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e25c8a-7121-45c0-9833-b3f3253cf4b0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.195677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 781/1597] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.196496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab351ec-5192-498d-a349-8972506cc4ce admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.202197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 817/1598] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.203278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e25c8a-7121-45c0-9833-b3f3253cf4b0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.209601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab351ec-5192-498d-a349-8972506cc4ce admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.214235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e25c8a-7121-45c0-9833-b3f3253cf4b0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.214380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072d3e5-f17f-49ea-b8c6-e9fd5c08c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.214998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072d3e5-f17f-49ea-b8c6-e9fd5c08c246 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.215964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072d3e5-f17f-49ea-b8c6-e9fd5c08c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.216248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072d3e5-f17f-49ea-b8c6-e9fd5c08c246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.217031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072d3e5-f17f-49ea-b8c6-e9fd5c08c246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.218617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072d3e5-f17f-49ea-b8c6-e9fd5c08c246 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.219442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d789f-f1b9-40d8-81a6-c68ae9eb5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.220096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d789f-f1b9-40d8-81a6-c68ae9eb5cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.220380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d789f-f1b9-40d8-81a6-c68ae9eb5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.220662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d789f-f1b9-40d8-81a6-c68ae9eb5cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.221384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d789f-f1b9-40d8-81a6-c68ae9eb5cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.222942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d789f-f1b9-40d8-81a6-c68ae9eb5cd5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.228698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 782/1599] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.232278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072d3e5-f17f-49ea-b8c6-e9fd5c08c246 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.233584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 818/1600] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.234262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d789f-f1b9-40d8-81a6-c68ae9eb5cd5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.242586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072d3e5-f17f-49ea-b8c6-e9fd5c08c246 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.243485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d789f-f1b9-40d8-81a6-c68ae9eb5cd5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.247489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa586b-f310-4cf3-a1ce-570943879d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.247967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d282c96-69c2-47d4-bde6-02351082d403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.248392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa586b-f310-4cf3-a1ce-570943879d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.248677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa586b-f310-4cf3-a1ce-570943879d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.248814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d282c96-69c2-47d4-bde6-02351082d403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.248955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa586b-f310-4cf3-a1ce-570943879d34 admin admin] PATH_INFO: `/v3/projects/bc7ff8b3d32245e2b421b7e8f75c20fb/users/c1c14d9018eb4c60962b013392995343/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.249095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d282c96-69c2-47d4-bde6-02351082d403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.249369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d282c96-69c2-47d4-bde6-02351082d403 admin admin] PATH_INFO: `/v3/projects/54ea2b32b88f4eaeb738e72903024234/users/d619c0247a084d07941bd70c14b66b39/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.264447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa586b-f310-4cf3-a1ce-570943879d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7ff8b3d32245e2b421b7e8f75c20fb, user_id=c1c14d9018eb4c60962b013392995343, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.265214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d282c96-69c2-47d4-bde6-02351082d403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ea2b32b88f4eaeb738e72903024234, user_id=d619c0247a084d07941bd70c14b66b39, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.267157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa586b-f310-4cf3-a1ce-570943879d34 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.267963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d282c96-69c2-47d4-bde6-02351082d403 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.280846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 783/1601] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:47 2022] PUT /identity/v3/projects/bc7ff8b3d32245e2b421b7e8f75c20fb/users/c1c14d9018eb4c60962b013392995343/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:47.281459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa586b-f310-4cf3-a1ce-570943879d34 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.281750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 819/1602] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:47 2022] PUT /identity/v3/projects/54ea2b32b88f4eaeb738e72903024234/users/d619c0247a084d07941bd70c14b66b39/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:47.283071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2f3e-058a-4023-bfcf-ac207ba32c5e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.283388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2f3e-058a-4023-bfcf-ac207ba32c5e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.283670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2f3e-058a-4023-bfcf-ac207ba32c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.309683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6ddd2f3e-058a-4023-bfcf-ac207ba32c5e None None] MFA Rules not processed for user `b765ef82028e4ff29c0986768595aa32`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:47.310796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6ddd2f3e-058a-4023-bfcf-ac207ba32c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:47.347614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa586b-f310-4cf3-a1ce-570943879d34 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.369304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:47.378948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 820/1603] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:47.378948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2f3e-058a-4023-bfcf-ac207ba32c5e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.409392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca841c02-3a9e-41cc-ba3e-7a96c82a52b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.410297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca841c02-3a9e-41cc-ba3e-7a96c82a52b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.410703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca841c02-3a9e-41cc-ba3e-7a96c82a52b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.410988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca841c02-3a9e-41cc-ba3e-7a96c82a52b7 admin admin] PATH_INFO: `/v3/projects/21c128a60a1143c29f98f6c183f2ef30/users/699f2836d6264f3f938c0cc0e4618df9/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.427464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca841c02-3a9e-41cc-ba3e-7a96c82a52b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c128a60a1143c29f98f6c183f2ef30, user_id=699f2836d6264f3f938c0cc0e4618df9, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.430161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca841c02-3a9e-41cc-ba3e-7a96c82a52b7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.444332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2f3e-058a-4023-bfcf-ac207ba32c5e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.444860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 784/1604] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:47 2022] PUT /identity/v3/projects/21c128a60a1143c29f98f6c183f2ef30/users/699f2836d6264f3f938c0cc0e4618df9/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:47.452188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca841c02-3a9e-41cc-ba3e-7a96c82a52b7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.487587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:47.509329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81f5f2-de8d-47ca-a288-3a5da168c3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.510036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81f5f2-de8d-47ca-a288-3a5da168c3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.510322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81f5f2-de8d-47ca-a288-3a5da168c3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.510598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81f5f2-de8d-47ca-a288-3a5da168c3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.511387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81f5f2-de8d-47ca-a288-3a5da168c3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.513570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81f5f2-de8d-47ca-a288-3a5da168c3c3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.519316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca841c02-3a9e-41cc-ba3e-7a96c82a52b7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.526486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 821/1605] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.526486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81f5f2-de8d-47ca-a288-3a5da168c3c3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.527498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2df954-f1db-4bfc-afe8-acefe5576433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.528977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2df954-f1db-4bfc-afe8-acefe5576433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.529258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2df954-f1db-4bfc-afe8-acefe5576433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.529536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2df954-f1db-4bfc-afe8-acefe5576433 admin admin] PATH_INFO: `/v3/projects/70c03050388e40268957ecf17f0b25b6/users/1f3bcf808bb44fecbee4326d59c9c3a3/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.536215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81f5f2-de8d-47ca-a288-3a5da168c3c3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.540744 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99110b5a-03f1-4c6f-b583-71d32031def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.541384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99110b5a-03f1-4c6f-b583-71d32031def9 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.541660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99110b5a-03f1-4c6f-b583-71d32031def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.541929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99110b5a-03f1-4c6f-b583-71d32031def9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.542670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99110b5a-03f1-4c6f-b583-71d32031def9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.544205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2df954-f1db-4bfc-afe8-acefe5576433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c03050388e40268957ecf17f0b25b6, user_id=1f3bcf808bb44fecbee4326d59c9c3a3, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.544338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99110b5a-03f1-4c6f-b583-71d32031def9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.546827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2df954-f1db-4bfc-afe8-acefe5576433 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.553954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 822/1606] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.554802 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99110b5a-03f1-4c6f-b583-71d32031def9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.562946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 785/1607] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:47 2022] PUT /identity/v3/projects/70c03050388e40268957ecf17f0b25b6/users/1f3bcf808bb44fecbee4326d59c9c3a3/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:47.574373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1226e-a117-4ecc-b96f-d4264fdae336 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.575009 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99110b5a-03f1-4c6f-b583-71d32031def9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.575115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1226e-a117-4ecc-b96f-d4264fdae336 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.575115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1226e-a117-4ecc-b96f-d4264fdae336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.581874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-49d1226e-a117-4ecc-b96f-d4264fdae336 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:47.583145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-49d1226e-a117-4ecc-b96f-d4264fdae336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:47.630105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d275a-2dba-431b-893e-8ffd2da5ee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.630778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d275a-2dba-431b-893e-8ffd2da5ee8f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.631060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d275a-2dba-431b-893e-8ffd2da5ee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.631341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d275a-2dba-431b-893e-8ffd2da5ee8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.632157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d275a-2dba-431b-893e-8ffd2da5ee8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.633773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d275a-2dba-431b-893e-8ffd2da5ee8f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.642112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 786/1608] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:47.643226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042bd68-ab69-4cd9-bab8-adfafb1dadb1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.643616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042bd68-ab69-4cd9-bab8-adfafb1dadb1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.643927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042bd68-ab69-4cd9-bab8-adfafb1dadb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.647223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 823/1609] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:47.647223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d275a-2dba-431b-893e-8ffd2da5ee8f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.668125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e042bd68-ab69-4cd9-bab8-adfafb1dadb1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:47.669729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e042bd68-ab69-4cd9-bab8-adfafb1dadb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:47.673998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:47.678008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 787/1610] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:47.679236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9b392-5911-482f-9ead-b1a58e387253 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.679562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9b392-5911-482f-9ead-b1a58e387253 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.679837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9b392-5911-482f-9ead-b1a58e387253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.703591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d275a-2dba-431b-893e-8ffd2da5ee8f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.706322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-9bc9b392-5911-482f-9ead-b1a58e387253 None None] MFA Rules not processed for user `699f2836d6264f3f938c0cc0e4618df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:47.707239 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f701b-a786-414b-a8ea-93e1324940de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.707582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9bc9b392-5911-482f-9ead-b1a58e387253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:47.707917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f701b-a786-414b-a8ea-93e1324940de service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.708203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f701b-a786-414b-a8ea-93e1324940de service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.708479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f701b-a786-414b-a8ea-93e1324940de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.770549 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f701b-a786-414b-a8ea-93e1324940de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.771100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 788/1611] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:47.771957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9b392-5911-482f-9ead-b1a58e387253 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.772160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f701b-a786-414b-a8ea-93e1324940de service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.782274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9b392-5911-482f-9ead-b1a58e387253 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.782693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 824/1612] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:47.783565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f701b-a786-414b-a8ea-93e1324940de service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.787077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc135-7f50-4623-a2f7-64b8565751c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.787994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc135-7f50-4623-a2f7-64b8565751c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.788276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc135-7f50-4623-a2f7-64b8565751c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.788534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc135-7f50-4623-a2f7-64b8565751c0 admin admin] PATH_INFO: `/v3/projects/5f968a5b8c014409ac37f37626bef8e2/users/14db333461634fe78141fce97e6fe9d5/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.793387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f701b-a786-414b-a8ea-93e1324940de service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.797918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20214c-21c9-4863-aab7-b8869358a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.799056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20214c-21c9-4863-aab7-b8869358a626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.799189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20214c-21c9-4863-aab7-b8869358a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.799385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20214c-21c9-4863-aab7-b8869358a626 admin admin] PATH_INFO: `/v3/projects/53badf9667a544499080c3f426b50942/users/79b17e95e5f0434b854b196dee43154c/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.803595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bc135-7f50-4623-a2f7-64b8565751c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f968a5b8c014409ac37f37626bef8e2, user_id=14db333461634fe78141fce97e6fe9d5, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.806364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bc135-7f50-4623-a2f7-64b8565751c0 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.816280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20214c-21c9-4863-aab7-b8869358a626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53badf9667a544499080c3f426b50942, user_id=79b17e95e5f0434b854b196dee43154c, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.818993 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20214c-21c9-4863-aab7-b8869358a626 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.822941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 789/1613] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:47 2022] PUT /identity/v3/projects/5f968a5b8c014409ac37f37626bef8e2/users/14db333461634fe78141fce97e6fe9d5/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:47.824426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7c42-c25a-43bd-b4bf-9f8126ca38f1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.825338 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7c42-c25a-43bd-b4bf-9f8126ca38f1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.825708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7c42-c25a-43bd-b4bf-9f8126ca38f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.842113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 825/1614] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:47 2022] PUT /identity/v3/projects/53badf9667a544499080c3f426b50942/users/79b17e95e5f0434b854b196dee43154c/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:47.843615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20214c-21c9-4863-aab7-b8869358a626 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.860535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:47.865494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-188e7c42-c25a-43bd-b4bf-9f8126ca38f1 None None] MFA Rules not processed for user `1f3bcf808bb44fecbee4326d59c9c3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:47.867436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-188e7c42-c25a-43bd-b4bf-9f8126ca38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:47.919748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20214c-21c9-4863-aab7-b8869358a626 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:47.924502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0977c0-ae31-484e-a0d9-6a6d3f2e32ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:47.925396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0977c0-ae31-484e-a0d9-6a6d3f2e32ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:47.925678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0977c0-ae31-484e-a0d9-6a6d3f2e32ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:47.925953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0977c0-ae31-484e-a0d9-6a6d3f2e32ae admin admin] PATH_INFO: `/v3/projects/4b24eaa8a053477b9debce1f6640e514/users/cabc5ecafe6d443c8459b8857a1e3242/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:47.943361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0977c0-ae31-484e-a0d9-6a6d3f2e32ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b24eaa8a053477b9debce1f6640e514, user_id=cabc5ecafe6d443c8459b8857a1e3242, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:47.946819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0977c0-ae31-484e-a0d9-6a6d3f2e32ae admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:47.953452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 790/1615] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:47.954231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7c42-c25a-43bd-b4bf-9f8126ca38f1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:47.975134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 826/1616] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:47 2022] PUT /identity/v3/projects/4b24eaa8a053477b9debce1f6640e514/users/cabc5ecafe6d443c8459b8857a1e3242/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:47.976513 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0977c0-ae31-484e-a0d9-6a6d3f2e32ae admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.021434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.036449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7c42-c25a-43bd-b4bf-9f8126ca38f1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.051110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0977c0-ae31-484e-a0d9-6a6d3f2e32ae admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.054729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21faa5-00d7-4d1c-8262-838599343113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.055411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21faa5-00d7-4d1c-8262-838599343113 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.056128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21faa5-00d7-4d1c-8262-838599343113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.061421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21faa5-00d7-4d1c-8262-838599343113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.096738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37ea57-0959-4959-ba03-76dfc67f5a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.097978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37ea57-0959-4959-ba03-76dfc67f5a72 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.098676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37ea57-0959-4959-ba03-76dfc67f5a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.099076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37ea57-0959-4959-ba03-76dfc67f5a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.140357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21faa5-00d7-4d1c-8262-838599343113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.142098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21faa5-00d7-4d1c-8262-838599343113 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.152766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 827/1617] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:48.153578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21faa5-00d7-4d1c-8262-838599343113 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.163434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21faa5-00d7-4d1c-8262-838599343113 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.170877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1545b-67c6-41ef-b35e-d45cb1f19602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.171571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1545b-67c6-41ef-b35e-d45cb1f19602 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.171857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1545b-67c6-41ef-b35e-d45cb1f19602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.172598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37ea57-0959-4959-ba03-76dfc67f5a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.174038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37ea57-0959-4959-ba03-76dfc67f5a72 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.175693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1545b-67c6-41ef-b35e-d45cb1f19602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.176634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1545b-67c6-41ef-b35e-d45cb1f19602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.178827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1545b-67c6-41ef-b35e-d45cb1f19602 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.194821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 791/1618] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:48.197151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb8e5-0b88-4152-86d7-014a21c361af None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.197444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb8e5-0b88-4152-86d7-014a21c361af None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.197835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb8e5-0b88-4152-86d7-014a21c361af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.216803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 828/1619] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:48.218797 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada70ed9-3081-4a57-88e0-29b2d9068f5b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.219094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada70ed9-3081-4a57-88e0-29b2d9068f5b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.219448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada70ed9-3081-4a57-88e0-29b2d9068f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.224077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.241056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-efdcb8e5-0b88-4152-86d7-014a21c361af None None] MFA Rules not processed for user `14db333461634fe78141fce97e6fe9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:48.243281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-efdcb8e5-0b88-4152-86d7-014a21c361af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.251146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ada70ed9-3081-4a57-88e0-29b2d9068f5b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:48.252584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ada70ed9-3081-4a57-88e0-29b2d9068f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.339742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 829/1620] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:48.341111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e26e1d-0549-4932-ab2b-1b8511b2bc68 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.341401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e26e1d-0549-4932-ab2b-1b8511b2bc68 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.341681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e26e1d-0549-4932-ab2b-1b8511b2bc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.352346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 792/1621] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:48.353698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7d78-8f54-4485-bc29-1695a35246aa None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.353984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7d78-8f54-4485-bc29-1695a35246aa None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.354258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7d78-8f54-4485-bc29-1695a35246aa None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.357011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 793/1622] 10.222.0.77 () {54 vars in 961 bytes} [Tue Jun 7 14:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:48.361672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b5e26e1d-0549-4932-ab2b-1b8511b2bc68 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:48.362813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b5e26e1d-0549-4932-ab2b-1b8511b2bc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.369925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a7d78-8f54-4485-bc29-1695a35246aa None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.375608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 830/1623] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:48.375608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e26e1d-0549-4932-ab2b-1b8511b2bc68 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.390540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e26e1d-0549-4932-ab2b-1b8511b2bc68 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.396851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a7d78-8f54-4485-bc29-1695a35246aa None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.398099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.400047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.400538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.402054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] PATH_INFO: `/v3/users/dbb724c94786403994ca6f31ec2a17d0` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.404057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb724c94786403994ca6f31ec2a17d0)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.405634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: WARNING py.warnings [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:21:48.405634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: warnings.warn(msg) Jun 07 14:21:48.405634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: Jun 07 14:21:48.405908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9aa40-0d00-43cf-aed6-b5bae84654f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.406688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9aa40-0d00-43cf-aed6-b5bae84654f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.407044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9aa40-0d00-43cf-aed6-b5bae84654f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.407640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9aa40-0d00-43cf-aed6-b5bae84654f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.408477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.408596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9aa40-0d00-43cf-aed6-b5bae84654f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.411375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9aa40-0d00-43cf-aed6-b5bae84654f9 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.439479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 794/1624] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/users => generated 293 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:48.439479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9aa40-0d00-43cf-aed6-b5bae84654f9 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.490891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb724c94786403994ca6f31ec2a17d0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:48.495278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.504866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb724c94786403994ca6f31ec2a17d0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:48.505997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb724c94786403994ca6f31ec2a17d0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:48.516269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9aa40-0d00-43cf-aed6-b5bae84654f9 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.516991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb724c94786403994ca6f31ec2a17d0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:48.520465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.521523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.521801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.522089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.524040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.538784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.541617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c4b75b77-246a-4125-80ec-06bcc4685b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb724c94786403994ca6f31ec2a17d0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:48.541781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.549228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 831/1625] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:21:48 2022] DELETE /identity/v3/users/dbb724c94786403994ca6f31ec2a17d0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:48.550369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f10a47-a164-49a4-967a-80fd7ce6b369 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.550698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f10a47-a164-49a4-967a-80fd7ce6b369 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.550969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f10a47-a164-49a4-967a-80fd7ce6b369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.554158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 795/1626] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:48.555045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.556417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.572728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b11e77-1136-42a6-8e4d-e533267b3b24 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.584464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-56f10a47-a164-49a4-967a-80fd7ce6b369 None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:48.585796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-56f10a47-a164-49a4-967a-80fd7ce6b369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.660311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e6429-805c-431b-a155-2a77699393ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.662148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6429-805c-431b-a155-2a77699393ae service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.664142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6429-805c-431b-a155-2a77699393ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.664436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e6429-805c-431b-a155-2a77699393ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.667372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-934e6429-805c-431b-a155-2a77699393ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.716321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 832/1627] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:48.718713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0339-7018-4393-a3f8-ebb12e2f139e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.720661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0339-7018-4393-a3f8-ebb12e2f139e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.721353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e0339-7018-4393-a3f8-ebb12e2f139e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.725631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 833/1628] 10.222.0.77 () {54 vars in 961 bytes} [Tue Jun 7 14:21:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:48.727569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e0339-7018-4393-a3f8-ebb12e2f139e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.729910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:48.732269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4e7e0339-7018-4393-a3f8-ebb12e2f139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.788564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e6429-805c-431b-a155-2a77699393ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.792191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e6429-805c-431b-a155-2a77699393ae service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.810187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 796/1629] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:48.812158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c801d3-ccc8-433f-876b-d47b4f5aed8e None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.812615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c801d3-ccc8-433f-876b-d47b4f5aed8e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.813065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c801d3-ccc8-433f-876b-d47b4f5aed8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.836944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d9c801d3-ccc8-433f-876b-d47b4f5aed8e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:48.838389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d9c801d3-ccc8-433f-876b-d47b4f5aed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.839836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e0339-7018-4393-a3f8-ebb12e2f139e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.845575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ba81d-ea76-416c-b860-422c7b53da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.846577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ba81d-ea76-416c-b860-422c7b53da0a admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.847022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ba81d-ea76-416c-b860-422c7b53da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.847679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ba81d-ea76-416c-b860-422c7b53da0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.848407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 797/1630] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:48.848796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ba81d-ea76-416c-b860-422c7b53da0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.849966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cd944-ef97-4500-8001-94b713024397 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.850342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cd944-ef97-4500-8001-94b713024397 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.850720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cd944-ef97-4500-8001-94b713024397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.851634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ba81d-ea76-416c-b860-422c7b53da0a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.864873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 834/1631] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:48.866169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ba81d-ea76-416c-b860-422c7b53da0a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.881428 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ba81d-ea76-416c-b860-422c7b53da0a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.882064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6d2cd944-ef97-4500-8001-94b713024397 None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:48.894441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6d2cd944-ef97-4500-8001-94b713024397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.905357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 798/1632] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Jun 7 14:21:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:48.906222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cd944-ef97-4500-8001-94b713024397 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.912873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398b59c-4379-4730-b11f-f1943faccff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.914778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398b59c-4379-4730-b11f-f1943faccff3 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.915208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398b59c-4379-4730-b11f-f1943faccff3 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.915523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398b59c-4379-4730-b11f-f1943faccff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.917933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cd944-ef97-4500-8001-94b713024397 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:48.923181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6398b59c-4379-4730-b11f-f1943faccff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:48.923630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339f553-223a-4464-8c74-09386deeae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:48.924608 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339f553-223a-4464-8c74-09386deeae78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:48.924978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339f553-223a-4464-8c74-09386deeae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:48.925259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339f553-223a-4464-8c74-09386deeae78 admin admin] PATH_INFO: `/v3/projects/d74d8e676c1841cd836f5d4fd907c43e/users/3054e16386d04a058ea3d05691b2130c/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:48.945394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339f553-223a-4464-8c74-09386deeae78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74d8e676c1841cd836f5d4fd907c43e, user_id=3054e16386d04a058ea3d05691b2130c, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:48.949112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339f553-223a-4464-8c74-09386deeae78 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:48.971577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 799/1633] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:48 2022] PUT /identity/v3/projects/d74d8e676c1841cd836f5d4fd907c43e/users/3054e16386d04a058ea3d05691b2130c/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:48.971577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339f553-223a-4464-8c74-09386deeae78 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:48.972937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a339f553-223a-4464-8c74-09386deeae78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:49.046828 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:49.052969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398b59c-4379-4730-b11f-f1943faccff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.055129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398b59c-4379-4730-b11f-f1943faccff3 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.069451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 835/1634] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:49.073025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398b59c-4379-4730-b11f-f1943faccff3 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.091704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339f553-223a-4464-8c74-09386deeae78 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.097356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398b59c-4379-4730-b11f-f1943faccff3 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.098332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6da90-f3e8-4998-b315-94618c08f418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.099234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6da90-f3e8-4998-b315-94618c08f418 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.100059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6da90-f3e8-4998-b315-94618c08f418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.100412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6da90-f3e8-4998-b315-94618c08f418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.223068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6da90-f3e8-4998-b315-94618c08f418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.226683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6da90-f3e8-4998-b315-94618c08f418 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.231619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfb393-4902-49df-aa7a-d1faa2e965a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.234218 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb393-4902-49df-aa7a-d1faa2e965a7 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.234732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb393-4902-49df-aa7a-d1faa2e965a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.235223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb393-4902-49df-aa7a-d1faa2e965a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.242796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a7dfb393-4902-49df-aa7a-d1faa2e965a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:49.244665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 800/1635] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:49.245404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6da90-f3e8-4998-b315-94618c08f418 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.261663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6da90-f3e8-4998-b315-94618c08f418 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.270267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22744ecc-e28f-4470-b837-a2e868db94a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.271012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22744ecc-e28f-4470-b837-a2e868db94a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.271496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22744ecc-e28f-4470-b837-a2e868db94a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.271800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22744ecc-e28f-4470-b837-a2e868db94a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.272691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22744ecc-e28f-4470-b837-a2e868db94a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.274874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22744ecc-e28f-4470-b837-a2e868db94a4 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.294558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 801/1636] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:49.300179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22744ecc-e28f-4470-b837-a2e868db94a4 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.330305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22744ecc-e28f-4470-b837-a2e868db94a4 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.347195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e570321-7c61-453b-bb65-2f5ed3f101af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.347566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e570321-7c61-453b-bb65-2f5ed3f101af admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.347853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e570321-7c61-453b-bb65-2f5ed3f101af admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.348409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e570321-7c61-453b-bb65-2f5ed3f101af admin admin] PATH_INFO: `/v3/projects/d74d8e676c1841cd836f5d4fd907c43e/users/3054e16386d04a058ea3d05691b2130c/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.354096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e570321-7c61-453b-bb65-2f5ed3f101af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74d8e676c1841cd836f5d4fd907c43e, user_id=3054e16386d04a058ea3d05691b2130c, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.363449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e570321-7c61-453b-bb65-2f5ed3f101af admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.378475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfb393-4902-49df-aa7a-d1faa2e965a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.380477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfb393-4902-49df-aa7a-d1faa2e965a7 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.395704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 802/1637] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:49 2022] PUT /identity/v3/projects/d74d8e676c1841cd836f5d4fd907c43e/users/3054e16386d04a058ea3d05691b2130c/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:21:49.406415 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58b846-77d1-4a01-9ac2-4588d2f3b443 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.406709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58b846-77d1-4a01-9ac2-4588d2f3b443 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.406994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58b846-77d1-4a01-9ac2-4588d2f3b443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.419875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 836/1638] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:49.472400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-ea58b846-77d1-4a01-9ac2-4588d2f3b443 None None] MFA Rules not processed for user `3054e16386d04a058ea3d05691b2130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:49.474776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ea58b846-77d1-4a01-9ac2-4588d2f3b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:49.515872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:49.521361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c2ec1-170e-480d-b20c-e23a7809ef54 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.522401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c2ec1-170e-480d-b20c-e23a7809ef54 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.522540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c2ec1-170e-480d-b20c-e23a7809ef54 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.524669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 837/1639] 10.222.0.77 () {54 vars in 912 bytes} [Tue Jun 7 14:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 07 14:21:49.533083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0e225-f442-4373-aa5a-ac4e95b692b2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.533352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0e225-f442-4373-aa5a-ac4e95b692b2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.533665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0e225-f442-4373-aa5a-ac4e95b692b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.572519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d8a0e225-f442-4373-aa5a-ac4e95b692b2 None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:49.575309 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d8a0e225-f442-4373-aa5a-ac4e95b692b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:49.655209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 803/1640] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:49.655209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbfb92-4378-4614-a575-aeba23071362 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.659536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbfb92-4378-4614-a575-aeba23071362 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.661210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbfb92-4378-4614-a575-aeba23071362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.714459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-91cbfb92-4378-4614-a575-aeba23071362 None None] MFA Rules not processed for user `c1c14d9018eb4c60962b013392995343`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:49.716839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-91cbfb92-4378-4614-a575-aeba23071362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:49.740257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 838/1641] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:21:49.742471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0e225-f442-4373-aa5a-ac4e95b692b2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.745608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d8a0e225-f442-4373-aa5a-ac4e95b692b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:49.790312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:49.861899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 804/1642] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:49.862890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbfb92-4378-4614-a575-aeba23071362 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:49.865034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-91cbfb92-4378-4614-a575-aeba23071362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:49.865394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0e225-f442-4373-aa5a-ac4e95b692b2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.870960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237817a7-80fa-43f1-a8b6-dc6f837bb03e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.873123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237817a7-80fa-43f1-a8b6-dc6f837bb03e service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.874849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237817a7-80fa-43f1-a8b6-dc6f837bb03e service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.875277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237817a7-80fa-43f1-a8b6-dc6f837bb03e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.885436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbfb92-4378-4614-a575-aeba23071362 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:49.889293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237817a7-80fa-43f1-a8b6-dc6f837bb03e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.890008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78506ed-851b-4670-8f3f-cab9619d6999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:49.890758 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78506ed-851b-4670-8f3f-cab9619d6999 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.891046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78506ed-851b-4670-8f3f-cab9619d6999 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.891321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78506ed-851b-4670-8f3f-cab9619d6999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.891489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237817a7-80fa-43f1-a8b6-dc6f837bb03e service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.904621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78506ed-851b-4670-8f3f-cab9619d6999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:49.906259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78506ed-851b-4670-8f3f-cab9619d6999 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:49.907521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 839/1643] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:49.909463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75cc09-f787-488d-8dfa-0510dc38ddc2 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.909886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75cc09-f787-488d-8dfa-0510dc38ddc2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.910270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75cc09-f787-488d-8dfa-0510dc38ddc2 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.912129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 840/1644] 10.222.0.77 () {54 vars in 912 bytes} [Tue Jun 7 14:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:49.913400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11101fab-282e-4db8-a13f-8ac0b5cff0ae None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.913871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11101fab-282e-4db8-a13f-8ac0b5cff0ae None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.914248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11101fab-282e-4db8-a13f-8ac0b5cff0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.935894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-11101fab-282e-4db8-a13f-8ac0b5cff0ae None None] MFA Rules not processed for user `c1c14d9018eb4c60962b013392995343`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:49.937716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-11101fab-282e-4db8-a13f-8ac0b5cff0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:49.943118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 805/1645] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:49.950543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2743-3898-4c96-821e-19985eadd214 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:49.956883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2743-3898-4c96-821e-19985eadd214 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:49.957065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2743-3898-4c96-821e-19985eadd214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:49.994872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 841/1646] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:49.999988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-862a2743-3898-4c96-821e-19985eadd214 None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:50.000430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-862a2743-3898-4c96-821e-19985eadd214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:50.013817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 806/1647] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:50.072833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11101fab-282e-4db8-a13f-8ac0b5cff0ae None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:50.086625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11101fab-282e-4db8-a13f-8ac0b5cff0ae None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:50.094890 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8843e-d884-4966-ac98-b944f4442087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:50.095798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8843e-d884-4966-ac98-b944f4442087 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:50.096156 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8843e-d884-4966-ac98-b944f4442087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:50.096561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8843e-d884-4966-ac98-b944f4442087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:50.121277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8843e-d884-4966-ac98-b944f4442087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:50.123027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8843e-d884-4966-ac98-b944f4442087 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:50.149824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 842/1648] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:50.740632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2743-3898-4c96-821e-19985eadd214 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:50.742222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-862a2743-3898-4c96-821e-19985eadd214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:50.900735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2743-3898-4c96-821e-19985eadd214 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:50.913304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:50.914207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:50.914478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:50.914747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] PATH_INFO: `/v3/projects/2ac2989dcedc44549622cf3fc3099c96` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:50.917584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac2989dcedc44549622cf3fc3099c96)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:50.919198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: WARNING py.warnings [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 07 14:21:50.919198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: warnings.warn(msg) Jun 07 14:21:50.919198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: Jun 07 14:21:50.920423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:51.000117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:51.038747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8843e-d884-4966-ac98-b944f4442087 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:51.058612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8843e-d884-4966-ac98-b944f4442087 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:51.072364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac2989dcedc44549622cf3fc3099c96', 'request_id': 'req-717e3018-1220-4fe2-ab3f-f06f98a297ee'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.110747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac2989dcedc44549622cf3fc3099c96', 'request_id': 'req-717e3018-1220-4fe2-ab3f-f06f98a297ee'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.142108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac2989dcedc44549622cf3fc3099c96', 'request_id': 'req-717e3018-1220-4fe2-ab3f-f06f98a297ee'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.176038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] The token cache is being invalidate because project 2ac2989dcedc44549622cf3fc3099c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:21:51.176768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.182537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.191961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 807/1649] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:21:50 2022] DELETE /identity/v3/projects/2ac2989dcedc44549622cf3fc3099c96 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:51.199080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:51.206992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:51.274167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:51.278159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.278502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.278795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.287627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:51.403597 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e3018-1220-4fe2-ab3f-f06f98a297ee admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:51.415397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:51.417621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.417909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.418275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] PATH_INFO: `/v3/users/b765ef82028e4ff29c0986768595aa32` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.421895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b765ef82028e4ff29c0986768595aa32)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:51.426292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:51.436739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:51.442234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:51.471459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 843/1650] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:51.574110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b765ef82028e4ff29c0986768595aa32'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.580410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b765ef82028e4ff29c0986768595aa32'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.594995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b765ef82028e4ff29c0986768595aa32'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.596522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b765ef82028e4ff29c0986768595aa32'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.621097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e6dcae71-7c35-46f3-a68c-588101ccaea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b765ef82028e4ff29c0986768595aa32'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:51.663081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 808/1651] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:21:51 2022] DELETE /identity/v3/users/b765ef82028e4ff29c0986768595aa32 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:51.784946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:51.787018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:51.812364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94293-c205-487b-81ab-c05ec6eb5b61 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:51.869915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:51.894262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:51.895803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:51.895803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:51.896242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] PATH_INFO: `/v3/users/699f2836d6264f3f938c0cc0e4618df9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:51.898689 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=699f2836d6264f3f938c0cc0e4618df9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:51.900986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:51.985934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699f2836d6264f3f938c0cc0e4618df9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:52.010408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699f2836d6264f3f938c0cc0e4618df9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:52.011483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699f2836d6264f3f938c0cc0e4618df9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:52.029641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699f2836d6264f3f938c0cc0e4618df9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:52.055051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699f2836d6264f3f938c0cc0e4618df9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:52.073718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 844/1652] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:21:51 2022] DELETE /identity/v3/users/699f2836d6264f3f938c0cc0e4618df9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:52.075484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e642-9d3d-4bbf-8dd0-d8bfd8545786 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.076340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e642-9d3d-4bbf-8dd0-d8bfd8545786 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.076340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e642-9d3d-4bbf-8dd0-d8bfd8545786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.115130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a308e642-9d3d-4bbf-8dd0-d8bfd8545786 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:52.117695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a308e642-9d3d-4bbf-8dd0-d8bfd8545786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:52.142795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:52.212950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 809/1653] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:52.235604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.237061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:52.339463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfc55f-6f6c-47b9-96c1-c31f804cfd2d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:52.346020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02aec0-5c87-48a7-b47b-02d168f1d545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:52.346932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02aec0-5c87-48a7-b47b-02d168f1d545 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.347390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02aec0-5c87-48a7-b47b-02d168f1d545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.347901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02aec0-5c87-48a7-b47b-02d168f1d545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.363865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02aec0-5c87-48a7-b47b-02d168f1d545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:52.365790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02aec0-5c87-48a7-b47b-02d168f1d545 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:52.380638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 845/1654] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:52.705305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8e9b-e83f-4aee-8e75-dbbd8d2fbbe5 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.705760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8e9b-e83f-4aee-8e75-dbbd8d2fbbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.706205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c8e9b-e83f-4aee-8e75-dbbd8d2fbbe5 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.709180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 810/1655] 10.222.0.77 () {54 vars in 912 bytes} [Tue Jun 7 14:21:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:52.715080 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7c400-8ec2-4f0c-a65a-ece1698b011e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:52.715575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7c400-8ec2-4f0c-a65a-ece1698b011e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:52.716041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7c400-8ec2-4f0c-a65a-ece1698b011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:52.825961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-63f7c400-8ec2-4f0c-a65a-ece1698b011e None None] MFA Rules not processed for user `fafd295a115c4f5d912e49d6a21d67b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:52.827191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-63f7c400-8ec2-4f0c-a65a-ece1698b011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:52.865695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 846/1656] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:52.950771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c8e9b-e83f-4aee-8e75-dbbd8d2fbbe5 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:52.954955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4b5c8e9b-e83f-4aee-8e75-dbbd8d2fbbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:52.994857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c8e9b-e83f-4aee-8e75-dbbd8d2fbbe5 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:53.011097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe613c-5dcb-4c19-92bf-ad32481c3313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:53.012279 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe613c-5dcb-4c19-92bf-ad32481c3313 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:53.012806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe613c-5dcb-4c19-92bf-ad32481c3313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:53.013272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe613c-5dcb-4c19-92bf-ad32481c3313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:53.041557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe613c-5dcb-4c19-92bf-ad32481c3313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:53.046444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe613c-5dcb-4c19-92bf-ad32481c3313 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:53.064031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 811/1657] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:21:53.648129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7c400-8ec2-4f0c-a65a-ece1698b011e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:53.650988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-63f7c400-8ec2-4f0c-a65a-ece1698b011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:53.679821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7c400-8ec2-4f0c-a65a-ece1698b011e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:53.688584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:53.690757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:53.691278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:53.691968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] PATH_INFO: `/v3/projects/549ff6b360a3462ca1fa0d83658a4c33` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:53.707575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549ff6b360a3462ca1fa0d83658a4c33)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:53.711394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:53.846668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:53.884746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549ff6b360a3462ca1fa0d83658a4c33', 'request_id': 'req-c546d263-c6df-4842-a3a0-25c2553d81e7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:53.913142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549ff6b360a3462ca1fa0d83658a4c33', 'request_id': 'req-c546d263-c6df-4842-a3a0-25c2553d81e7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:53.937600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549ff6b360a3462ca1fa0d83658a4c33', 'request_id': 'req-c546d263-c6df-4842-a3a0-25c2553d81e7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:53.967676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] The token cache is being invalidate because project 549ff6b360a3462ca1fa0d83658a4c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:21:53.968015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:53.970776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c546d263-c6df-4842-a3a0-25c2553d81e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:53.973877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 847/1658] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:21:53 2022] DELETE /identity/v3/projects/549ff6b360a3462ca1fa0d83658a4c33 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:53.979061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4158552-8980-49d5-85fd-c07108de7b10 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:53.979666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4158552-8980-49d5-85fd-c07108de7b10 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:53.979829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4158552-8980-49d5-85fd-c07108de7b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.010139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b4158552-8980-49d5-85fd-c07108de7b10 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:54.012778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b4158552-8980-49d5-85fd-c07108de7b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:54.210888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 812/1659] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:54.217762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb53a60-bd16-4f3a-8ab4-202ed7b962f6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.218535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb53a60-bd16-4f3a-8ab4-202ed7b962f6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.218989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb53a60-bd16-4f3a-8ab4-202ed7b962f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.243819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8cb53a60-bd16-4f3a-8ab4-202ed7b962f6 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:54.245385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8cb53a60-bd16-4f3a-8ab4-202ed7b962f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:54.258845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 848/1660] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:54.264654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4158552-8980-49d5-85fd-c07108de7b10 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:54.278465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4158552-8980-49d5-85fd-c07108de7b10 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:54.285291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0bdf-707c-4c1a-91eb-714360118105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:54.286261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0bdf-707c-4c1a-91eb-714360118105 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.286696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0bdf-707c-4c1a-91eb-714360118105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.287474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0bdf-707c-4c1a-91eb-714360118105 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.288374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd0bdf-707c-4c1a-91eb-714360118105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:21:54.290425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd0bdf-707c-4c1a-91eb-714360118105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:54.292339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd0bdf-707c-4c1a-91eb-714360118105 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:54.345896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb53a60-bd16-4f3a-8ab4-202ed7b962f6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:54.347835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 813/1661] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:21:54.366128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb53a60-bd16-4f3a-8ab4-202ed7b962f6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:54.376063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da414e-21c1-4035-b795-713c565d96b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:54.376801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da414e-21c1-4035-b795-713c565d96b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.376983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da414e-21c1-4035-b795-713c565d96b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.377443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da414e-21c1-4035-b795-713c565d96b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.378331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da414e-21c1-4035-b795-713c565d96b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:54.382590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da414e-21c1-4035-b795-713c565d96b4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:54.456304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 849/1662] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:54 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:21:54.458021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0bdf-707c-4c1a-91eb-714360118105 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:54.476217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0bdf-707c-4c1a-91eb-714360118105 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:54.624993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6eb7d-2a46-41ab-a771-d8d6595b741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:54.625657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6eb7d-2a46-41ab-a771-d8d6595b741a admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.626427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6eb7d-2a46-41ab-a771-d8d6595b741a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.626427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6eb7d-2a46-41ab-a771-d8d6595b741a admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.627316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6eb7d-2a46-41ab-a771-d8d6595b741a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:54.633395 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6eb7d-2a46-41ab-a771-d8d6595b741a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:54.681090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 814/1663] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:54 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:54.682125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da414e-21c1-4035-b795-713c565d96b4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:54.696329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da414e-21c1-4035-b795-713c565d96b4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:54.714244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78a726-ed6b-4d98-a143-368bc76e0773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:54.721053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78a726-ed6b-4d98-a143-368bc76e0773 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.722379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78a726-ed6b-4d98-a143-368bc76e0773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.722814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78a726-ed6b-4d98-a143-368bc76e0773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.724530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78a726-ed6b-4d98-a143-368bc76e0773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:54.737147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d78a726-ed6b-4d98-a143-368bc76e0773 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:54.787909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6eb7d-2a46-41ab-a771-d8d6595b741a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:54.793814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 850/1664] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:54.796160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78a726-ed6b-4d98-a143-368bc76e0773 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:54.798490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9d78a726-ed6b-4d98-a143-368bc76e0773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:54.809484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6eb7d-2a46-41ab-a771-d8d6595b741a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:54.837528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78a726-ed6b-4d98-a143-368bc76e0773 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:54.844615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:54.844855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b41d8-6448-419c-9aac-1c14569f4094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:54.845503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.845785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.846063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] PATH_INFO: `/v3/projects/21c128a60a1143c29f98f6c183f2ef30` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.846278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b41d8-6448-419c-9aac-1c14569f4094 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.847285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c128a60a1143c29f98f6c183f2ef30)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:54.847761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b41d8-6448-419c-9aac-1c14569f4094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.849335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b41d8-6448-419c-9aac-1c14569f4094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:54.852155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b41d8-6448-419c-9aac-1c14569f4094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:54.853332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:54.863060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b41d8-6448-419c-9aac-1c14569f4094 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:54.911391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 815/1665] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:54.913561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b41d8-6448-419c-9aac-1c14569f4094 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:54.958951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b41d8-6448-419c-9aac-1c14569f4094 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:54.981174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff8e12-d350-4f01-8fcc-40913faf79f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:54.983730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8e12-d350-4f01-8fcc-40913faf79f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:54.984030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8e12-d350-4f01-8fcc-40913faf79f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:54.984982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8e12-d350-4f01-8fcc-40913faf79f3 admin admin] PATH_INFO: `/v3/projects/6d6e9bf978414b9783ef3b7c4b806c85/users/1c64ea0e22a64f56bd2e044edeb0afbd/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.032833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c128a60a1143c29f98f6c183f2ef30', 'request_id': 'req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.033720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8e12-d350-4f01-8fcc-40913faf79f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e9bf978414b9783ef3b7c4b806c85, user_id=1c64ea0e22a64f56bd2e044edeb0afbd, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.041503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8e12-d350-4f01-8fcc-40913faf79f3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.046063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c128a60a1143c29f98f6c183f2ef30', 'request_id': 'req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.051773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:55.057596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c128a60a1143c29f98f6c183f2ef30', 'request_id': 'req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.074613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 816/1666] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:54 2022] PUT /identity/v3/projects/6d6e9bf978414b9783ef3b7c4b806c85/users/1c64ea0e22a64f56bd2e044edeb0afbd/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:55.076161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc28f-0ce4-45be-a478-42ea6f1ed4ad None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.077437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc28f-0ce4-45be-a478-42ea6f1ed4ad None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.077729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decc28f-0ce4-45be-a478-42ea6f1ed4ad None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.085643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 817/1667] 10.222.0.77 () {54 vars in 960 bytes} [Tue Jun 7 14:21:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:21:55.086540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc28f-0ce4-45be-a478-42ea6f1ed4ad None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.095145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1decc28f-0ce4-45be-a478-42ea6f1ed4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:55.095689 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] The token cache is being invalidate because project 21c128a60a1143c29f98f6c183f2ef30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:21:55.096003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.096748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-eb1f8043-a90e-4b79-b373-bc1e3dc371bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.098639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 851/1668] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:21:54 2022] DELETE /identity/v3/projects/21c128a60a1143c29f98f6c183f2ef30 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:55.099971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72c900-df72-4dc4-a9fb-80bec5989029 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.100262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72c900-df72-4dc4-a9fb-80bec5989029 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.100545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72c900-df72-4dc4-a9fb-80bec5989029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.135706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-af72c900-df72-4dc4-a9fb-80bec5989029 None None] MFA Rules not processed for user `1c64ea0e22a64f56bd2e044edeb0afbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:55.137771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-af72c900-df72-4dc4-a9fb-80bec5989029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:55.258985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:55.268061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 852/1669] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:55.273942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765b1c-65f2-46bc-aad7-013cd274ce41 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.274314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765b1c-65f2-46bc-aad7-013cd274ce41 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.274671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62765b1c-65f2-46bc-aad7-013cd274ce41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.311264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decc28f-0ce4-45be-a478-42ea6f1ed4ad None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.321965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.322874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.323161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.323466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] PATH_INFO: `/v3/users/14db333461634fe78141fce97e6fe9d5` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.329807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14db333461634fe78141fce97e6fe9d5)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.332937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.353692 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-62765b1c-65f2-46bc-aad7-013cd274ce41 None None] MFA Rules not processed for user `a0cc577feba04e66b950a69b918d4ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:55.357408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-62765b1c-65f2-46bc-aad7-013cd274ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:55.441928 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14db333461634fe78141fce97e6fe9d5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.443441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14db333461634fe78141fce97e6fe9d5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.463450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14db333461634fe78141fce97e6fe9d5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.465772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14db333461634fe78141fce97e6fe9d5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.521310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14db333461634fe78141fce97e6fe9d5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.571697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 853/1670] 10.222.0.77 () {58 vars in 1057 bytes} [Tue Jun 7 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:55.572556 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765b1c-65f2-46bc-aad7-013cd274ce41 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.575747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 818/1671] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:21:55 2022] DELETE /identity/v3/users/14db333461634fe78141fce97e6fe9d5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:55.576817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-62765b1c-65f2-46bc-aad7-013cd274ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:55.576916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.579415 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:55.614035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62765b1c-65f2-46bc-aad7-013cd274ce41 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.732702 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055d0ee-f274-4c0c-bb3b-0b97f17aa51f admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.733388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.734298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.734588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.734870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] PATH_INFO: `/v3/users/3054e16386d04a058ea3d05691b2130c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.739773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06252665-f0ad-4629-93b7-78f0c8e187ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:55.741041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06252665-f0ad-4629-93b7-78f0c8e187ae admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.741460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3054e16386d04a058ea3d05691b2130c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.741719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06252665-f0ad-4629-93b7-78f0c8e187ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.742172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06252665-f0ad-4629-93b7-78f0c8e187ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.743050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06252665-f0ad-4629-93b7-78f0c8e187ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:55.743512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.745547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06252665-f0ad-4629-93b7-78f0c8e187ae admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:55.780962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:55.803404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 819/1672] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:21:55 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:55.803404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06252665-f0ad-4629-93b7-78f0c8e187ae admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:55.840657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3054e16386d04a058ea3d05691b2130c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.854272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3054e16386d04a058ea3d05691b2130c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.856504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3054e16386d04a058ea3d05691b2130c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.872356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3054e16386d04a058ea3d05691b2130c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.902407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4111d582-75d4-4a95-b2b4-78f93c709159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3054e16386d04a058ea3d05691b2130c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:55.917482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 854/1673] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:21:55 2022] DELETE /identity/v3/users/3054e16386d04a058ea3d05691b2130c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:55.920766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e576e-6b80-4eb3-b077-89374ad3234a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:55.923324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e576e-6b80-4eb3-b077-89374ad3234a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:55.925161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e576e-6b80-4eb3-b077-89374ad3234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:55.969244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06252665-f0ad-4629-93b7-78f0c8e187ae admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:55.974656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-012e576e-6b80-4eb3-b077-89374ad3234a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:55.977950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-012e576e-6b80-4eb3-b077-89374ad3234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:56.000741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:56.113069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4d72a-753a-4f69-b67b-d33af4d51fdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.113806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4d72a-753a-4f69-b67b-d33af4d51fdc service placement] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.114503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4d72a-753a-4f69-b67b-d33af4d51fdc service placement] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.114794 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4d72a-753a-4f69-b67b-d33af4d51fdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.118256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b4f4d72a-753a-4f69-b67b-d33af4d51fdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:56.127067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 855/1674] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:56.127411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e576e-6b80-4eb3-b077-89374ad3234a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.131443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-012e576e-6b80-4eb3-b077-89374ad3234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:56.145468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4d72a-753a-4f69-b67b-d33af4d51fdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.147181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4d72a-753a-4f69-b67b-d33af4d51fdc service placement] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.159842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e576e-6b80-4eb3-b077-89374ad3234a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.175940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737996a-ac73-41d7-b86c-8f7705137c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.176704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737996a-ac73-41d7-b86c-8f7705137c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.176999 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737996a-ac73-41d7-b86c-8f7705137c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.178338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737996a-ac73-41d7-b86c-8f7705137c1d admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.180543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737996a-ac73-41d7-b86c-8f7705137c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.183386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 820/1675] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:56.184940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737996a-ac73-41d7-b86c-8f7705137c1d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.240508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 856/1676] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:21:56 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:21:56.243702 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4d72a-753a-4f69-b67b-d33af4d51fdc service placement] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.269109 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4d72a-753a-4f69-b67b-d33af4d51fdc service placement] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.308644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd08f5b-e1f9-4ae8-85fb-65190808e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.309511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd08f5b-e1f9-4ae8-85fb-65190808e475 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.311630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd08f5b-e1f9-4ae8-85fb-65190808e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.312115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd08f5b-e1f9-4ae8-85fb-65190808e475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.312941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd08f5b-e1f9-4ae8-85fb-65190808e475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.318306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd08f5b-e1f9-4ae8-85fb-65190808e475 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.345617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 821/1677] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:56.349541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737996a-ac73-41d7-b86c-8f7705137c1d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.369135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737996a-ac73-41d7-b86c-8f7705137c1d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.387330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b26e7-cb03-47eb-ad0d-a12f6cffcbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.394031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b26e7-cb03-47eb-ad0d-a12f6cffcbe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.398930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b26e7-cb03-47eb-ad0d-a12f6cffcbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.399860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b26e7-cb03-47eb-ad0d-a12f6cffcbe4 admin admin] PATH_INFO: `/v3/projects/ea949e484f4d4509a197513a94da1fde/users/d0ef170d74ff47b5b149eaddc44f733e/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.445322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b26e7-cb03-47eb-ad0d-a12f6cffcbe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea949e484f4d4509a197513a94da1fde, user_id=d0ef170d74ff47b5b149eaddc44f733e, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.451736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b26e7-cb03-47eb-ad0d-a12f6cffcbe4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.506116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 857/1678] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:56 2022] PUT /identity/v3/projects/ea949e484f4d4509a197513a94da1fde/users/d0ef170d74ff47b5b149eaddc44f733e/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:56.507895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd08f5b-e1f9-4ae8-85fb-65190808e475 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.524305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd08f5b-e1f9-4ae8-85fb-65190808e475 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.580087 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b26e7-cb03-47eb-ad0d-a12f6cffcbe4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.580829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dc6b26e7-cb03-47eb-ad0d-a12f6cffcbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:56.749413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf884d4-5dca-408d-98bc-73b6f8aa5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.750735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf884d4-5dca-408d-98bc-73b6f8aa5e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.751192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf884d4-5dca-408d-98bc-73b6f8aa5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.751650 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf884d4-5dca-408d-98bc-73b6f8aa5e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.753796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf884d4-5dca-408d-98bc-73b6f8aa5e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.756217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf884d4-5dca-408d-98bc-73b6f8aa5e32 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.798691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 822/1679] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:21:56.811389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf884d4-5dca-408d-98bc-73b6f8aa5e32 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.836737 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b26e7-cb03-47eb-ad0d-a12f6cffcbe4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.838685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf884d4-5dca-408d-98bc-73b6f8aa5e32 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.854889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d9994-fae3-4d77-8361-57d282eb0228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.854889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9994-fae3-4d77-8361-57d282eb0228 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.854889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9994-fae3-4d77-8361-57d282eb0228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.854889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9994-fae3-4d77-8361-57d282eb0228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.864412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f049da1-b5ed-4a8d-9229-b70c3a1faba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:56.865614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049da1-b5ed-4a8d-9229-b70c3a1faba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.865977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049da1-b5ed-4a8d-9229-b70c3a1faba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.866459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049da1-b5ed-4a8d-9229-b70c3a1faba8 admin admin] PATH_INFO: `/v3/projects/ea949e484f4d4509a197513a94da1fde/users/d0ef170d74ff47b5b149eaddc44f733e/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.873853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d9994-fae3-4d77-8361-57d282eb0228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.875475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d9994-fae3-4d77-8361-57d282eb0228 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.882075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f049da1-b5ed-4a8d-9229-b70c3a1faba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea949e484f4d4509a197513a94da1fde, user_id=d0ef170d74ff47b5b149eaddc44f733e, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:56.890118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f049da1-b5ed-4a8d-9229-b70c3a1faba8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:56.897051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 858/1680] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:21:56.897970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d9994-fae3-4d77-8361-57d282eb0228 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:56.903557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-115d9994-fae3-4d77-8361-57d282eb0228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:56.928182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 823/1681] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:21:56 2022] PUT /identity/v3/projects/ea949e484f4d4509a197513a94da1fde/users/d0ef170d74ff47b5b149eaddc44f733e/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:56.937303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d9994-fae3-4d77-8361-57d282eb0228 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:56.938805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75aaf-b081-40ce-a6d4-8b5bfde9378d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:56.939177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75aaf-b081-40ce-a6d4-8b5bfde9378d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:56.939557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75aaf-b081-40ce-a6d4-8b5bfde9378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:56.960689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:57.029861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-64e75aaf-b081-40ce-a6d4-8b5bfde9378d None None] MFA Rules not processed for user `d0ef170d74ff47b5b149eaddc44f733e`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:57.031563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-64e75aaf-b081-40ce-a6d4-8b5bfde9378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:57.121938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:57.123288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.123612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.123902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] PATH_INFO: `/v3/users/1f3bcf808bb44fecbee4326d59c9c3a3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.127185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3bcf808bb44fecbee4326d59c9c3a3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:57.134600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:57.189756 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 824/1682] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:21:57.199499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:57.208233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e75aaf-b081-40ce-a6d4-8b5bfde9378d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:57.209707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-64e75aaf-b081-40ce-a6d4-8b5bfde9378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:57.252440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3bcf808bb44fecbee4326d59c9c3a3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:57.267185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3bcf808bb44fecbee4326d59c9c3a3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:57.269482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3bcf808bb44fecbee4326d59c9c3a3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:57.284567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3bcf808bb44fecbee4326d59c9c3a3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:57.308795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1746c9e7-bd94-428d-8939-092a4dd27830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3bcf808bb44fecbee4326d59c9c3a3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:57.322373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 859/1683] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:21:56 2022] DELETE /identity/v3/users/1f3bcf808bb44fecbee4326d59c9c3a3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:57.329529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3d398-a225-4c0f-baf1-180cc282f50a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.329741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3d398-a225-4c0f-baf1-180cc282f50a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.330024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3d398-a225-4c0f-baf1-180cc282f50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.345015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e75aaf-b081-40ce-a6d4-8b5bfde9378d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:57.369521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dcb3d398-a225-4c0f-baf1-180cc282f50a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:57.373040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dcb3d398-a225-4c0f-baf1-180cc282f50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:57.458552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:57.459583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.459882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.460218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.462302 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:57.544824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 860/1684] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:57.561178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3d398-a225-4c0f-baf1-180cc282f50a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:57.564971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dcb3d398-a225-4c0f-baf1-180cc282f50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:57.575573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:57.580482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:57.583063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:57.604193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 825/1685] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:21:57.699828 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3d398-a225-4c0f-baf1-180cc282f50a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:57.712097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084e3a5-c85d-4690-a88f-671d6430c67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:57.712817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084e3a5-c85d-4690-a88f-671d6430c67f service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.713492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084e3a5-c85d-4690-a88f-671d6430c67f service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.713774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084e3a5-c85d-4690-a88f-671d6430c67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.738859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:57.740578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:57.742485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084e3a5-c85d-4690-a88f-671d6430c67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:57.743977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084e3a5-c85d-4690-a88f-671d6430c67f service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:57.758797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b27907-3bf9-49a5-b985-05559b4bda7b service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:57.766628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c619-2bab-473d-871f-b78148aab92d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:57.767462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c619-2bab-473d-871f-b78148aab92d service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:57.767842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c619-2bab-473d-871f-b78148aab92d service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:57.768217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c619-2bab-473d-871f-b78148aab92d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:57.769213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 861/1686] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:21:57.770663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-af71c619-2bab-473d-871f-b78148aab92d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:57.922052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c619-2bab-473d-871f-b78148aab92d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:57.924219 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c619-2bab-473d-871f-b78148aab92d service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:57.952479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 826/1687] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:21:58.653875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084e3a5-c85d-4690-a88f-671d6430c67f service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:58.655412 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7084e3a5-c85d-4690-a88f-671d6430c67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:58.696313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084e3a5-c85d-4690-a88f-671d6430c67f service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:58.716796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:58.718104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:58.718540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:58.719139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] PATH_INFO: `/v3/projects/d74d8e676c1841cd836f5d4fd907c43e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:58.722625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74d8e676c1841cd836f5d4fd907c43e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:58.728970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:58.812822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:58.847685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74d8e676c1841cd836f5d4fd907c43e', 'request_id': 'req-ba2edec9-118d-4418-ac7d-b9e9e758401f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:58.874000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74d8e676c1841cd836f5d4fd907c43e', 'request_id': 'req-ba2edec9-118d-4418-ac7d-b9e9e758401f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:58.888516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74d8e676c1841cd836f5d4fd907c43e', 'request_id': 'req-ba2edec9-118d-4418-ac7d-b9e9e758401f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:58.913936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] The token cache is being invalidate because project d74d8e676c1841cd836f5d4fd907c43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:21:58.914857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:58.917087 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ba2edec9-118d-4418-ac7d-b9e9e758401f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:58.924188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 862/1688] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:21:58 2022] DELETE /identity/v3/projects/d74d8e676c1841cd836f5d4fd907c43e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:58.929173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c492f5-85e4-4267-a07f-7b476a30a38a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:58.929643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c492f5-85e4-4267-a07f-7b476a30a38a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:58.934414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c492f5-85e4-4267-a07f-7b476a30a38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:58.966454 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-00c492f5-85e4-4267-a07f-7b476a30a38a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:58.967533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-00c492f5-85e4-4267-a07f-7b476a30a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:59.050712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c6b3e-98d7-427d-bbd7-fc6ec9ea4b98 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.051149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c6b3e-98d7-427d-bbd7-fc6ec9ea4b98 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.051590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c6b3e-98d7-427d-bbd7-fc6ec9ea4b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.159940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 827/1689] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:59.166808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c492f5-85e4-4267-a07f-7b476a30a38a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:59.177646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c52c6b3e-98d7-427d-bbd7-fc6ec9ea4b98 None None] MFA Rules not processed for user `79b17e95e5f0434b854b196dee43154c`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:59.179415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c52c6b3e-98d7-427d-bbd7-fc6ec9ea4b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:59.179541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-00c492f5-85e4-4267-a07f-7b476a30a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:59.215666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c492f5-85e4-4267-a07f-7b476a30a38a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:21:59.237776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:21:59.240260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.242386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.242752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] PATH_INFO: `/v3/projects/70c03050388e40268957ecf17f0b25b6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.249947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c03050388e40268957ecf17f0b25b6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:21:59.252050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:21:59.389502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c03050388e40268957ecf17f0b25b6', 'request_id': 'req-e9ae9576-1355-480f-8d17-7cdadec217f5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:59.399960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c03050388e40268957ecf17f0b25b6', 'request_id': 'req-e9ae9576-1355-480f-8d17-7cdadec217f5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:59.410968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 863/1690] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:21:59.412698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6231e9-ece0-49c1-849d-cd400399f20b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.413001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6231e9-ece0-49c1-849d-cd400399f20b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.413512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6231e9-ece0-49c1-849d-cd400399f20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.419935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c03050388e40268957ecf17f0b25b6', 'request_id': 'req-e9ae9576-1355-480f-8d17-7cdadec217f5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:59.438286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1f6231e9-ece0-49c1-849d-cd400399f20b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:59.440112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1f6231e9-ece0-49c1-849d-cd400399f20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:59.470000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] The token cache is being invalidate because project 70c03050388e40268957ecf17f0b25b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:21:59.484231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:59.486308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e9ae9576-1355-480f-8d17-7cdadec217f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:21:59.494067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 828/1691] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:21:59 2022] DELETE /identity/v3/projects/70c03050388e40268957ecf17f0b25b6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:21:59.494067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02af13-10f0-4a97-9f41-73d484316fef None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.494067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02af13-10f0-4a97-9f41-73d484316fef None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.494067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02af13-10f0-4a97-9f41-73d484316fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.540995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1f02af13-10f0-4a97-9f41-73d484316fef None None] MFA Rules not processed for user `79b17e95e5f0434b854b196dee43154c`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:59.551362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1f02af13-10f0-4a97-9f41-73d484316fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:59.570344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:59.682644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 829/1692] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:59.685115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22b2f5-d00f-4928-9987-bf2bd58d25d0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.686592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22b2f5-d00f-4928-9987-bf2bd58d25d0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.686894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22b2f5-d00f-4928-9987-bf2bd58d25d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.696669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 864/1693] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:59.702395 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cbfa1-0578-43c8-ace3-095a7e30615b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:21:59.702971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cbfa1-0578-43c8-ace3-095a7e30615b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:21:59.703460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cbfa1-0578-43c8-ace3-095a7e30615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:21:59.732401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6d22b2f5-d00f-4928-9987-bf2bd58d25d0 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:59.736823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6d22b2f5-d00f-4928-9987-bf2bd58d25d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:59.766911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 830/1694] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:59.766911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22b2f5-d00f-4928-9987-bf2bd58d25d0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:21:59.768690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6d22b2f5-d00f-4928-9987-bf2bd58d25d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:59.782565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5e1cbfa1-0578-43c8-ace3-095a7e30615b None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:21:59.785302 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5e1cbfa1-0578-43c8-ace3-095a7e30615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:21:59.958647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:21:59.997661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 865/1695] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:21:59.999025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cbfa1-0578-43c8-ace3-095a7e30615b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.043712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22b2f5-d00f-4928-9987-bf2bd58d25d0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.046508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cbfa1-0578-43c8-ace3-095a7e30615b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.050428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16da24-75fa-4158-b35f-92d715eca9c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.051210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16da24-75fa-4158-b35f-92d715eca9c4 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.052170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16da24-75fa-4158-b35f-92d715eca9c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.052450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16da24-75fa-4158-b35f-92d715eca9c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.054144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb607-6263-43a4-8ad6-b8be2518a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.054515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6a16da24-75fa-4158-b35f-92d715eca9c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.054960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb607-6263-43a4-8ad6-b8be2518a1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.067010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb607-6263-43a4-8ad6-b8be2518a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.067622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb607-6263-43a4-8ad6-b8be2518a1d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.069201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb607-6263-43a4-8ad6-b8be2518a1d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:00.071721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb607-6263-43a4-8ad6-b8be2518a1d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.074539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb607-6263-43a4-8ad6-b8be2518a1d1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.080019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16da24-75fa-4158-b35f-92d715eca9c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.084127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16da24-75fa-4158-b35f-92d715eca9c4 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.093789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 866/1696] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:00.099213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983d701-cc6d-4452-a312-8a87ed0d8f5d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.099573 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983d701-cc6d-4452-a312-8a87ed0d8f5d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.100009 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983d701-cc6d-4452-a312-8a87ed0d8f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.127380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 831/1697] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:21:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:00.128806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16da24-75fa-4158-b35f-92d715eca9c4 service nova] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.137651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1983d701-cc6d-4452-a312-8a87ed0d8f5d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:00.139078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1983d701-cc6d-4452-a312-8a87ed0d8f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.154043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16da24-75fa-4158-b35f-92d715eca9c4 service nova] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.164629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 867/1698] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:00.166297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983d701-cc6d-4452-a312-8a87ed0d8f5d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.169098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1983d701-cc6d-4452-a312-8a87ed0d8f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.174259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8895c-5b93-4c3d-b355-ce1694f62d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.174953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8895c-5b93-4c3d-b355-ce1694f62d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.175243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8895c-5b93-4c3d-b355-ce1694f62d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.175642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8895c-5b93-4c3d-b355-ce1694f62d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.176331 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8895c-5b93-4c3d-b355-ce1694f62d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.178313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8895c-5b93-4c3d-b355-ce1694f62d29 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.186144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983d701-cc6d-4452-a312-8a87ed0d8f5d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.193026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.195174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.195596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.195879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] PATH_INFO: `/v3/projects/5f968a5b8c014409ac37f37626bef8e2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.197403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f968a5b8c014409ac37f37626bef8e2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.202444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.272784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 832/1699] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:00 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:00.273983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8895c-5b93-4c3d-b355-ce1694f62d29 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.327730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f968a5b8c014409ac37f37626bef8e2', 'request_id': 'req-8134672a-2ffc-4cfb-8323-acf50875c541'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:00.341522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f968a5b8c014409ac37f37626bef8e2', 'request_id': 'req-8134672a-2ffc-4cfb-8323-acf50875c541'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:00.350021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f968a5b8c014409ac37f37626bef8e2', 'request_id': 'req-8134672a-2ffc-4cfb-8323-acf50875c541'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:00.366275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] The token cache is being invalidate because project 5f968a5b8c014409ac37f37626bef8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:00.366564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:00.367238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:00.368936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 868/1700] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:00 2022] DELETE /identity/v3/projects/5f968a5b8c014409ac37f37626bef8e2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:00.374073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.375652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.432230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8895c-5b93-4c3d-b355-ce1694f62d29 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.518749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:00.537754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134672a-2ffc-4cfb-8323-acf50875c541 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.543689 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1095d-24a0-450d-900d-8deb518237ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.545805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1095d-24a0-450d-900d-8deb518237ce admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.546100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1095d-24a0-450d-900d-8deb518237ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.546381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1095d-24a0-450d-900d-8deb518237ce admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.547101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1095d-24a0-450d-900d-8deb518237ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.554926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1095d-24a0-450d-900d-8deb518237ce admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.604132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 869/1701] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:00 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:00.605369 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deb92e-5bd1-43e5-be1a-a7822e9c443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.606173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deb92e-5bd1-43e5-be1a-a7822e9c443e admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.608013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deb92e-5bd1-43e5-be1a-a7822e9c443e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.608013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deb92e-5bd1-43e5-be1a-a7822e9c443e admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.608013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deb92e-5bd1-43e5-be1a-a7822e9c443e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:00.608427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deb92e-5bd1-43e5-be1a-a7822e9c443e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.609272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1095d-24a0-450d-900d-8deb518237ce admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.610348 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deb92e-5bd1-43e5-be1a-a7822e9c443e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.611380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ffc1095d-24a0-450d-900d-8deb518237ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.644460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 833/1702] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:00.644460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c8eb3-9221-4d2b-8101-f29230c20a3c None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.644460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c8eb3-9221-4d2b-8101-f29230c20a3c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.644460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c8eb3-9221-4d2b-8101-f29230c20a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.696658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-eb6c8eb3-9221-4d2b-8101-f29230c20a3c None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:00.698115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eb6c8eb3-9221-4d2b-8101-f29230c20a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.718049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 834/1703] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:00.719142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c8eb3-9221-4d2b-8101-f29230c20a3c None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.728212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:00.743687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c8eb3-9221-4d2b-8101-f29230c20a3c None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.762661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1095d-24a0-450d-900d-8deb518237ce admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.765050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55287b-9ba2-4964-8c7e-58c8617d0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.765760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55287b-9ba2-4964-8c7e-58c8617d0195 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.766048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55287b-9ba2-4964-8c7e-58c8617d0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.769196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55287b-9ba2-4964-8c7e-58c8617d0195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.770621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55287b-9ba2-4964-8c7e-58c8617d0195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.774596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55287b-9ba2-4964-8c7e-58c8617d0195 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.781996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332eb41-5836-43e8-8817-860e835699f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.783447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332eb41-5836-43e8-8817-860e835699f8 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.783748 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332eb41-5836-43e8-8817-860e835699f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.784038 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332eb41-5836-43e8-8817-860e835699f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.786730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5332eb41-5836-43e8-8817-860e835699f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.791405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 835/1704] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:00.791405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55287b-9ba2-4964-8c7e-58c8617d0195 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.792720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0c55287b-9ba2-4964-8c7e-58c8617d0195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.825353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55287b-9ba2-4964-8c7e-58c8617d0195 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:00.838321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6526b-2b7d-4a33-953a-0b6c05cb5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:00.839013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6526b-2b7d-4a33-953a-0b6c05cb5370 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.840235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6526b-2b7d-4a33-953a-0b6c05cb5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.840528 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6526b-2b7d-4a33-953a-0b6c05cb5370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.841243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6526b-2b7d-4a33-953a-0b6c05cb5370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.847452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6526b-2b7d-4a33-953a-0b6c05cb5370 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.914797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 836/1705] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:00 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:00.916826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab6a85-f58d-4dfe-b7af-c06b40f067da None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:00.919782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab6a85-f58d-4dfe-b7af-c06b40f067da None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:00.920102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab6a85-f58d-4dfe-b7af-c06b40f067da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:00.935637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332eb41-5836-43e8-8817-860e835699f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:00.945923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332eb41-5836-43e8-8817-860e835699f8 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:00.968827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 870/1706] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:22:00.969730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332eb41-5836-43e8-8817-860e835699f8 service swift] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:00.970410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d5ab6a85-f58d-4dfe-b7af-c06b40f067da None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:00.971722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d5ab6a85-f58d-4dfe-b7af-c06b40f067da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:00.994240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332eb41-5836-43e8-8817-860e835699f8 service swift] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.145059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 837/1707] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:01.146585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eac7a4-78b5-467e-98fa-707fd499627b None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.146971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eac7a4-78b5-467e-98fa-707fd499627b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.147251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eac7a4-78b5-467e-98fa-707fd499627b None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.165107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 838/1708] 10.222.0.77 () {54 vars in 912 bytes} [Tue Jun 7 14:22:01 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:01.166104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eac7a4-78b5-467e-98fa-707fd499627b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.182465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc816-f678-4500-b247-470611527b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.183193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc816-f678-4500-b247-470611527b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.184142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc816-f678-4500-b247-470611527b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.189482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc816-f678-4500-b247-470611527b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.190458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc816-f678-4500-b247-470611527b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.198993 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc816-f678-4500-b247-470611527b7a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.212506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eac7a4-78b5-467e-98fa-707fd499627b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.233573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875619c-a583-4050-8bca-ecc5e10587b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.234371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875619c-a583-4050-8bca-ecc5e10587b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.234682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875619c-a583-4050-8bca-ecc5e10587b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.234965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875619c-a583-4050-8bca-ecc5e10587b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.240521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875619c-a583-4050-8bca-ecc5e10587b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.245157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875619c-a583-4050-8bca-ecc5e10587b5 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.247074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 871/1709] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:01.248156 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc816-f678-4500-b247-470611527b7a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.281157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc816-f678-4500-b247-470611527b7a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.307253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528a8bb-2dae-421b-befc-a0a7e7745254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.307979 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528a8bb-2dae-421b-befc-a0a7e7745254 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.308317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528a8bb-2dae-421b-befc-a0a7e7745254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.309161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528a8bb-2dae-421b-befc-a0a7e7745254 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.322492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528a8bb-2dae-421b-befc-a0a7e7745254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:01.322492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528a8bb-2dae-421b-befc-a0a7e7745254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.329199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 839/1710] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:01 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:01.331666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51722f8-6558-4eda-8bbe-34dacd95b794 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.333058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528a8bb-2dae-421b-befc-a0a7e7745254 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.335924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51722f8-6558-4eda-8bbe-34dacd95b794 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.337358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51722f8-6558-4eda-8bbe-34dacd95b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.376624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 872/1711] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:01.376624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528a8bb-2dae-421b-befc-a0a7e7745254 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.397581 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a51722f8-6558-4eda-8bbe-34dacd95b794 None None] MFA Rules not processed for user `fafd295a115c4f5d912e49d6a21d67b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:01.403120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a51722f8-6558-4eda-8bbe-34dacd95b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:01.431802 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528a8bb-2dae-421b-befc-a0a7e7745254 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.455302 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daaade-5389-4d91-8b43-75cad9781224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.462701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daaade-5389-4d91-8b43-75cad9781224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.463065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daaade-5389-4d91-8b43-75cad9781224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.463326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daaade-5389-4d91-8b43-75cad9781224 admin admin] PATH_INFO: `/v3/projects/9a589c2aba6c448899f817b0f74b5971/users/2116d6e5122e494e83db6074890b6e95/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.526242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daaade-5389-4d91-8b43-75cad9781224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a589c2aba6c448899f817b0f74b5971, user_id=2116d6e5122e494e83db6074890b6e95, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.530631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daaade-5389-4d91-8b43-75cad9781224 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.582842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 873/1712] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:01 2022] PUT /identity/v3/projects/9a589c2aba6c448899f817b0f74b5971/users/2116d6e5122e494e83db6074890b6e95/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:01.582842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daaade-5389-4d91-8b43-75cad9781224 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.659669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 840/1713] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:01.661073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51722f8-6558-4eda-8bbe-34dacd95b794 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:01.709985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51722f8-6558-4eda-8bbe-34dacd95b794 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.742013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.769032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:01.801901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daaade-5389-4d91-8b43-75cad9781224 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:01.823788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986cf22-661f-4156-ba51-3cd22d3cad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.824541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986cf22-661f-4156-ba51-3cd22d3cad82 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.824827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986cf22-661f-4156-ba51-3cd22d3cad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.825108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986cf22-661f-4156-ba51-3cd22d3cad82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.825857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986cf22-661f-4156-ba51-3cd22d3cad82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.827510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986cf22-661f-4156-ba51-3cd22d3cad82 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:01.881089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 874/1714] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:01.882662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcea736-7d06-42d2-85ea-d0f751ddba80 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.882957 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcea736-7d06-42d2-85ea-d0f751ddba80 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.883237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcea736-7d06-42d2-85ea-d0f751ddba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.959894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6dcea736-7d06-42d2-85ea-d0f751ddba80 None None] MFA Rules not processed for user `2116d6e5122e494e83db6074890b6e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:01.961545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6dcea736-7d06-42d2-85ea-d0f751ddba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:01.974744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada4aac-3599-4edb-983b-f0a5b744667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:01.975466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada4aac-3599-4edb-983b-f0a5b744667f admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:01.975986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada4aac-3599-4edb-983b-f0a5b744667f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:01.976273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada4aac-3599-4edb-983b-f0a5b744667f admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:01.976983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada4aac-3599-4edb-983b-f0a5b744667f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:01.982917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada4aac-3599-4edb-983b-f0a5b744667f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.080740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 841/1715] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:01 2022] POST /identity/v3/projects => generated 373 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:02.086728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada4aac-3599-4edb-983b-f0a5b744667f admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.092182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0ada4aac-3599-4edb-983b-f0a5b744667f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:02.113112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 875/1716] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:02.114083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcea736-7d06-42d2-85ea-d0f751ddba80 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.139089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcea736-7d06-42d2-85ea-d0f751ddba80 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.256224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada4aac-3599-4edb-983b-f0a5b744667f admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.260797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10a610-095b-4820-abe8-174f8af97aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.261525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10a610-095b-4820-abe8-174f8af97aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.261815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10a610-095b-4820-abe8-174f8af97aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.262097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10a610-095b-4820-abe8-174f8af97aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.275709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10a610-095b-4820-abe8-174f8af97aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.278822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10a610-095b-4820-abe8-174f8af97aa1 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.296234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 842/1717] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:02.297328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10a610-095b-4820-abe8-174f8af97aa1 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.298889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136b201-8b17-42bf-97e6-e82be77d9f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.299377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136b201-8b17-42bf-97e6-e82be77d9f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.299666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136b201-8b17-42bf-97e6-e82be77d9f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.299944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136b201-8b17-42bf-97e6-e82be77d9f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.300675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136b201-8b17-42bf-97e6-e82be77d9f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.302285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136b201-8b17-42bf-97e6-e82be77d9f2b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.310628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10a610-095b-4820-abe8-174f8af97aa1 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.347486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 876/1718] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:02.347486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136b201-8b17-42bf-97e6-e82be77d9f2b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.357742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdb325-5b89-4776-9640-008c3eb5016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.362392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdb325-5b89-4776-9640-008c3eb5016b admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.362798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdb325-5b89-4776-9640-008c3eb5016b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.363018 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdb325-5b89-4776-9640-008c3eb5016b admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.364952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdb325-5b89-4776-9640-008c3eb5016b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.374966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136b201-8b17-42bf-97e6-e82be77d9f2b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.375681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdb325-5b89-4776-9640-008c3eb5016b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.394190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1771c-11d0-4d51-8881-4195b7413ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.394702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1771c-11d0-4d51-8881-4195b7413ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.394939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1771c-11d0-4d51-8881-4195b7413ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.395230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1771c-11d0-4d51-8881-4195b7413ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.395958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1771c-11d0-4d51-8881-4195b7413ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.398467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1771c-11d0-4d51-8881-4195b7413ea0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.439239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 843/1719] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:02 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:02.444247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdb325-5b89-4776-9640-008c3eb5016b admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.487055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 877/1720] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:02 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:02.488060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1771c-11d0-4d51-8881-4195b7413ea0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.497658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdb325-5b89-4776-9640-008c3eb5016b admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.717691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:02.750074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1771c-11d0-4d51-8881-4195b7413ea0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.757422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6396-4304-42f1-872e-91e8faf029fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.762895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6396-4304-42f1-872e-91e8faf029fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.763191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6396-4304-42f1-872e-91e8faf029fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.767158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24ead0-6ff3-4c50-b6e5-fdf3ae06f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.767329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6396-4304-42f1-872e-91e8faf029fe admin admin] PATH_INFO: `/v3/projects/8ce4017322bc451ebcf9a7fbdeecf903/users/fe3f1558279448f3928ce66c8555c9c6/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.776631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24ead0-6ff3-4c50-b6e5-fdf3ae06f28f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.777781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24ead0-6ff3-4c50-b6e5-fdf3ae06f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.780715 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24ead0-6ff3-4c50-b6e5-fdf3ae06f28f admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.781666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24ead0-6ff3-4c50-b6e5-fdf3ae06f28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.789167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24ead0-6ff3-4c50-b6e5-fdf3ae06f28f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.821989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 878/1721] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:02.823008 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24ead0-6ff3-4c50-b6e5-fdf3ae06f28f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.831695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d6396-4304-42f1-872e-91e8faf029fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce4017322bc451ebcf9a7fbdeecf903, user_id=fe3f1558279448f3928ce66c8555c9c6, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.841932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d6396-4304-42f1-872e-91e8faf029fe admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.850125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24ead0-6ff3-4c50-b6e5-fdf3ae06f28f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:02.894865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 844/1722] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:02 2022] PUT /identity/v3/projects/8ce4017322bc451ebcf9a7fbdeecf903/users/fe3f1558279448f3928ce66c8555c9c6/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:02.897524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6396-4304-42f1-872e-91e8faf029fe admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:02.905723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c3dc1-4451-4d48-aa89-ff83992c9f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:02.906531 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c3dc1-4451-4d48-aa89-ff83992c9f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.906823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c3dc1-4451-4d48-aa89-ff83992c9f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.907102 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c3dc1-4451-4d48-aa89-ff83992c9f8a admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:02.909881 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c3dc1-4451-4d48-aa89-ff83992c9f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:02.915311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c3dc1-4451-4d48-aa89-ff83992c9f8a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:02.916893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:02.976603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 879/1723] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:02 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:02.980318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c470cb-3066-4fb8-a8b3-1ba89842ea37 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:02.980612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c470cb-3066-4fb8-a8b3-1ba89842ea37 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:02.980894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c470cb-3066-4fb8-a8b3-1ba89842ea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:03.028627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-26c470cb-3066-4fb8-a8b3-1ba89842ea37 None None] MFA Rules not processed for user `fafd295a115c4f5d912e49d6a21d67b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:03.030089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-26c470cb-3066-4fb8-a8b3-1ba89842ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:03.101487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 880/1724] 10.222.0.72 () {58 vars in 1015 bytes} [Tue Jun 7 14:22:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:03.102916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7afbb-1fce-442b-b06c-e913394c6c7e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:03.103741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7afbb-1fce-442b-b06c-e913394c6c7e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:03.103741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7afbb-1fce-442b-b06c-e913394c6c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:03.166670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a6b7afbb-1fce-442b-b06c-e913394c6c7e None None] MFA Rules not processed for user `fe3f1558279448f3928ce66c8555c9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:03.167725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a6b7afbb-1fce-442b-b06c-e913394c6c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:03.213854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6396-4304-42f1-872e-91e8faf029fe admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:03.248350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961078e-0cbb-411a-81f2-ada8c621c4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:03.249066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961078e-0cbb-411a-81f2-ada8c621c4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:03.249356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961078e-0cbb-411a-81f2-ada8c621c4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:03.249639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961078e-0cbb-411a-81f2-ada8c621c4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:03.250393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961078e-0cbb-411a-81f2-ada8c621c4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:03.252211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961078e-0cbb-411a-81f2-ada8c621c4d5 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:03.303465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 845/1725] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:03.304507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961078e-0cbb-411a-81f2-ada8c621c4d5 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:03.346388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 881/1726] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:03.347550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7afbb-1fce-442b-b06c-e913394c6c7e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:03.349177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961078e-0cbb-411a-81f2-ada8c621c4d5 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:03.372601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62d99-b63b-4d17-9b68-39dfa6b01c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:03.373710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62d99-b63b-4d17-9b68-39dfa6b01c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:03.373999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62d99-b63b-4d17-9b68-39dfa6b01c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:03.374339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62d99-b63b-4d17-9b68-39dfa6b01c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:03.375228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd62d99-b63b-4d17-9b68-39dfa6b01c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:03.376952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd62d99-b63b-4d17-9b68-39dfa6b01c6c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:03.398770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7afbb-1fce-442b-b06c-e913394c6c7e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:03.410874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 846/1727] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:03.412362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62d99-b63b-4d17-9b68-39dfa6b01c6c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:03.415784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907654f9-82f6-497a-a4f3-a119c24bd905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:03.416670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907654f9-82f6-497a-a4f3-a119c24bd905 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:03.417105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907654f9-82f6-497a-a4f3-a119c24bd905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:03.418181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907654f9-82f6-497a-a4f3-a119c24bd905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:03.437793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62d99-b63b-4d17-9b68-39dfa6b01c6c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:03.441059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907654f9-82f6-497a-a4f3-a119c24bd905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:03.444773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907654f9-82f6-497a-a4f3-a119c24bd905 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:03.486861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04bdef-c167-4e9a-8556-7325daed2188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:03.494356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04bdef-c167-4e9a-8556-7325daed2188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:03.494714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04bdef-c167-4e9a-8556-7325daed2188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:03.494867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04bdef-c167-4e9a-8556-7325daed2188 admin admin] PATH_INFO: `/v3/projects/0ebbaae9bb0e41f3adac89fa8f3c8bf6/users/20af48d99bc14c0497981db470e5605f/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:03.503223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 882/1728] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:03.508750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907654f9-82f6-497a-a4f3-a119c24bd905 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:03.526763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04bdef-c167-4e9a-8556-7325daed2188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebbaae9bb0e41f3adac89fa8f3c8bf6, user_id=20af48d99bc14c0497981db470e5605f, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:03.538805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04bdef-c167-4e9a-8556-7325daed2188 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:03.558930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907654f9-82f6-497a-a4f3-a119c24bd905 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:03.596065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f98d81-9305-4a9f-860b-e7d324f46eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:03.596782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f98d81-9305-4a9f-860b-e7d324f46eee admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:03.597058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f98d81-9305-4a9f-860b-e7d324f46eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:03.597360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f98d81-9305-4a9f-860b-e7d324f46eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:03.598175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f98d81-9305-4a9f-860b-e7d324f46eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:03.598712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 847/1729] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:03 2022] PUT /identity/v3/projects/0ebbaae9bb0e41f3adac89fa8f3c8bf6/users/20af48d99bc14c0497981db470e5605f/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:03.600120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04bdef-c167-4e9a-8556-7325daed2188 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:03.606292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f98d81-9305-4a9f-860b-e7d324f46eee admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:03.720816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 883/1730] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:03 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:03.722235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135bf3-a36b-4bee-9bf8-ec3bcc8dfba9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:03.722529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135bf3-a36b-4bee-9bf8-ec3bcc8dfba9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:03.722802 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08135bf3-a36b-4bee-9bf8-ec3bcc8dfba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:03.830441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04bdef-c167-4e9a-8556-7325daed2188 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:03.830849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-08135bf3-a36b-4bee-9bf8-ec3bcc8dfba9 None None] MFA Rules not processed for user `20af48d99bc14c0497981db470e5605f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:03.863457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-08135bf3-a36b-4bee-9bf8-ec3bcc8dfba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:04.014877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:04.183199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe4c40-6060-489f-9531-d7aedfab4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:04.186211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 884/1731] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:04.188280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08135bf3-a36b-4bee-9bf8-ec3bcc8dfba9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.189676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe4c40-6060-489f-9531-d7aedfab4047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.189811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe4c40-6060-489f-9531-d7aedfab4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.191901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe4c40-6060-489f-9531-d7aedfab4047 admin admin] PATH_INFO: `/v3/projects/ebea1c69f4d24bf78b360863b31a2e01/users/d763db99f51541b8a13ec718b6cdbc7d/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.215745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08135bf3-a36b-4bee-9bf8-ec3bcc8dfba9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:04.233599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d0b58-119d-42d6-aaa4-2d12007de302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:04.235725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d0b58-119d-42d6-aaa4-2d12007de302 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.239330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d0b58-119d-42d6-aaa4-2d12007de302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.239701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d0b58-119d-42d6-aaa4-2d12007de302 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.240490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d0b58-119d-42d6-aaa4-2d12007de302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:04.245518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d0b58-119d-42d6-aaa4-2d12007de302 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:04.260370 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe4c40-6060-489f-9531-d7aedfab4047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebea1c69f4d24bf78b360863b31a2e01, user_id=d763db99f51541b8a13ec718b6cdbc7d, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:04.271554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe4c40-6060-489f-9531-d7aedfab4047 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:04.296537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:04.317777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 885/1732] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:04 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:04.321163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff9652-c151-42da-955a-5fca084c2be2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.321810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff9652-c151-42da-955a-5fca084c2be2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.323640 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff9652-c151-42da-955a-5fca084c2be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.332371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 848/1733] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:03 2022] PUT /identity/v3/projects/ebea1c69f4d24bf78b360863b31a2e01/users/d763db99f51541b8a13ec718b6cdbc7d/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:04.332371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe4c40-6060-489f-9531-d7aedfab4047 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.504983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-15ff9652-c151-42da-955a-5fca084c2be2 None None] MFA Rules not processed for user `d619c0247a084d07941bd70c14b66b39`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:04.506540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-15ff9652-c151-42da-955a-5fca084c2be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:04.643709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe4c40-6060-489f-9531-d7aedfab4047 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:04.665846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9edf56-e784-416b-a204-3b803f419dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:04.666494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9edf56-e784-416b-a204-3b803f419dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.666778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9edf56-e784-416b-a204-3b803f419dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.667054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9edf56-e784-416b-a204-3b803f419dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.667863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9edf56-e784-416b-a204-3b803f419dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:04.669459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9edf56-e784-416b-a204-3b803f419dc7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:04.695221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 886/1734] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:04.696534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff9652-c151-42da-955a-5fca084c2be2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.712036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff9652-c151-42da-955a-5fca084c2be2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:04.720777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 849/1735] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:04.722485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412666-d2b3-4d78-b04a-2d32c85f1fa4 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.722975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412666-d2b3-4d78-b04a-2d32c85f1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.723264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412666-d2b3-4d78-b04a-2d32c85f1fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.729903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e696656-9f07-479c-83b5-e75d4471bb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:04.732110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e696656-9f07-479c-83b5-e75d4471bb3d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:04.732623 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e696656-9f07-479c-83b5-e75d4471bb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:04.733152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e696656-9f07-479c-83b5-e75d4471bb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:04.734290 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e696656-9f07-479c-83b5-e75d4471bb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:04.736379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e696656-9f07-479c-83b5-e75d4471bb3d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:04.791993 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 887/1736] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:04.793791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e696656-9f07-479c-83b5-e75d4471bb3d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:04.794258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-14412666-d2b3-4d78-b04a-2d32c85f1fa4 None None] MFA Rules not processed for user `79b17e95e5f0434b854b196dee43154c`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:04.797323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-14412666-d2b3-4d78-b04a-2d32c85f1fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:04.803892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5e696656-9f07-479c-83b5-e75d4471bb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:05.012177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 850/1737] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:05.012971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412666-d2b3-4d78-b04a-2d32c85f1fa4 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:05.048402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412666-d2b3-4d78-b04a-2d32c85f1fa4 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:05.061085 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d0d68-9d7c-4fba-82aa-1f30836123f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:05.062005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d0d68-9d7c-4fba-82aa-1f30836123f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.062309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d0d68-9d7c-4fba-82aa-1f30836123f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.062611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d0d68-9d7c-4fba-82aa-1f30836123f8 admin admin] PATH_INFO: `/v3/projects/52e748a288994916958222ddfe25c30e/users/e756a131824643a39a86713b2be35edd/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.125055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d0d68-9d7c-4fba-82aa-1f30836123f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e748a288994916958222ddfe25c30e, user_id=e756a131824643a39a86713b2be35edd, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:05.144856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d0d68-9d7c-4fba-82aa-1f30836123f8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.145491 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e696656-9f07-479c-83b5-e75d4471bb3d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:05.165368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c726a0-4663-47e3-ae44-19a49f36c7b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:05.170173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c726a0-4663-47e3-ae44-19a49f36c7b9 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.170173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c726a0-4663-47e3-ae44-19a49f36c7b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.170173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c726a0-4663-47e3-ae44-19a49f36c7b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.187293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 851/1738] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:05 2022] PUT /identity/v3/projects/52e748a288994916958222ddfe25c30e/users/e756a131824643a39a86713b2be35edd/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:05.190464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d0d68-9d7c-4fba-82aa-1f30836123f8 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:05.260798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:05.409165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c726a0-4663-47e3-ae44-19a49f36c7b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:05.411435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c726a0-4663-47e3-ae44-19a49f36c7b9 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.483476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d0d68-9d7c-4fba-82aa-1f30836123f8 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:05.492180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf4e27-9de2-45a3-8472-7c4149856f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:05.493098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4e27-9de2-45a3-8472-7c4149856f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.493385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4e27-9de2-45a3-8472-7c4149856f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.493667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf4e27-9de2-45a3-8472-7c4149856f2c admin admin] PATH_INFO: `/v3/projects/ebea1c69f4d24bf78b360863b31a2e01/users/d763db99f51541b8a13ec718b6cdbc7d/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.496858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf4e27-9de2-45a3-8472-7c4149856f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebea1c69f4d24bf78b360863b31a2e01, user_id=d763db99f51541b8a13ec718b6cdbc7d, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:05.503168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf4e27-9de2-45a3-8472-7c4149856f2c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.508314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 888/1739] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:05.512213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c726a0-4663-47e3-ae44-19a49f36c7b9 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:05.554129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 852/1740] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:05 2022] PUT /identity/v3/projects/ebea1c69f4d24bf78b360863b31a2e01/users/d763db99f51541b8a13ec718b6cdbc7d/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:05.564659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf07610-be1b-4b0f-8260-512877192b28 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.565020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf07610-be1b-4b0f-8260-512877192b28 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.565257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf07610-be1b-4b0f-8260-512877192b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.585417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c726a0-4663-47e3-ae44-19a49f36c7b9 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:05.665451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:05.696432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-abf07610-be1b-4b0f-8260-512877192b28 None None] MFA Rules not processed for user `d763db99f51541b8a13ec718b6cdbc7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:05.697704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-abf07610-be1b-4b0f-8260-512877192b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:05.813210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708556c-a8f4-40d0-bd31-f3b832bc561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:05.817166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708556c-a8f4-40d0-bd31-f3b832bc561e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:05.817470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708556c-a8f4-40d0-bd31-f3b832bc561e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:05.817755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708556c-a8f4-40d0-bd31-f3b832bc561e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:05.824452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708556c-a8f4-40d0-bd31-f3b832bc561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:05.832189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708556c-a8f4-40d0-bd31-f3b832bc561e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:05.886823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 889/1741] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:05.888303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708556c-a8f4-40d0-bd31-f3b832bc561e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:06.007137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 853/1742] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:06.011543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf07610-be1b-4b0f-8260-512877192b28 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:06.075733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf07610-be1b-4b0f-8260-512877192b28 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:06.100075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432bfa6-215d-4a98-86c3-1248dc80ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:06.107850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432bfa6-215d-4a98-86c3-1248dc80ba01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:06.110517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432bfa6-215d-4a98-86c3-1248dc80ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:06.110992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432bfa6-215d-4a98-86c3-1248dc80ba01 admin admin] PATH_INFO: `/v3/projects/52e748a288994916958222ddfe25c30e/users/e756a131824643a39a86713b2be35edd/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:06.112462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708556c-a8f4-40d0-bd31-f3b832bc561e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:06.122403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432bfa6-215d-4a98-86c3-1248dc80ba01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e748a288994916958222ddfe25c30e, user_id=e756a131824643a39a86713b2be35edd, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:06.131893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d4ba2-dd07-4f13-b1d6-7a5ae4dd113c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:06.132650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d4ba2-dd07-4f13-b1d6-7a5ae4dd113c service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:06.132942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d4ba2-dd07-4f13-b1d6-7a5ae4dd113c service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:06.133223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d4ba2-dd07-4f13-b1d6-7a5ae4dd113c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:06.134639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432bfa6-215d-4a98-86c3-1248dc80ba01 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:06.194307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 854/1743] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:06 2022] PUT /identity/v3/projects/52e748a288994916958222ddfe25c30e/users/e756a131824643a39a86713b2be35edd/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:06.197173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432bfa6-215d-4a98-86c3-1248dc80ba01 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:06.210272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f432bfa6-215d-4a98-86c3-1248dc80ba01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:06.435328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:06.452367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d4ba2-dd07-4f13-b1d6-7a5ae4dd113c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:06.454172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d4ba2-dd07-4f13-b1d6-7a5ae4dd113c service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:06.466581 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432bfa6-215d-4a98-86c3-1248dc80ba01 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:06.496668 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb7fba-5dea-4db0-a370-f9277c9dfb9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:06.497580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb7fba-5dea-4db0-a370-f9277c9dfb9a service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:06.499151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb7fba-5dea-4db0-a370-f9277c9dfb9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:06.499151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb7fba-5dea-4db0-a370-f9277c9dfb9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:06.530421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 890/1744] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:06.536373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d14ab6-544d-492a-9807-35f98112611e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:06.536681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d14ab6-544d-492a-9807-35f98112611e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:06.538941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d14ab6-544d-492a-9807-35f98112611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:06.672309 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-67d14ab6-544d-492a-9807-35f98112611e None None] MFA Rules not processed for user `e756a131824643a39a86713b2be35edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:06.684787 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-67d14ab6-544d-492a-9807-35f98112611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:06.819292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb7fba-5dea-4db0-a370-f9277c9dfb9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:06.821242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb7fba-5dea-4db0-a370-f9277c9dfb9a service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:06.854645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 855/1745] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:07.061486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 891/1746] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:07.069624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb7fba-5dea-4db0-a370-f9277c9dfb9a service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:07.085062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb7fba-5dea-4db0-a370-f9277c9dfb9a service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:07.092446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026d186-6e03-4f14-bbb5-7ccef2bf9fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:07.093618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d186-6e03-4f14-bbb5-7ccef2bf9fca service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.094046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d186-6e03-4f14-bbb5-7ccef2bf9fca service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.094491 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026d186-6e03-4f14-bbb5-7ccef2bf9fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.129456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026d186-6e03-4f14-bbb5-7ccef2bf9fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:07.139022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026d186-6e03-4f14-bbb5-7ccef2bf9fca service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:07.189035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 856/1747] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:07.340572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d14ab6-544d-492a-9807-35f98112611e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:07.372694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d14ab6-544d-492a-9807-35f98112611e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:07.384096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182583ce-1945-44e6-b44a-20996a044474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:07.401153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182583ce-1945-44e6-b44a-20996a044474 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.401566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182583ce-1945-44e6-b44a-20996a044474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.402508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182583ce-1945-44e6-b44a-20996a044474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.564581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182583ce-1945-44e6-b44a-20996a044474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:07.570083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182583ce-1945-44e6-b44a-20996a044474 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:07.597656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 892/1748] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:07.785174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215fb1-4848-4cc6-808e-ba0d8e91dd75 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.786152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215fb1-4848-4cc6-808e-ba0d8e91dd75 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.786625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215fb1-4848-4cc6-808e-ba0d8e91dd75 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.788658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 857/1749] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:07.850536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fabf4-2d08-445d-9754-32f155f15a9c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:07.851029 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fabf4-2d08-445d-9754-32f155f15a9c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:07.851648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fabf4-2d08-445d-9754-32f155f15a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:07.892301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1c4fabf4-2d08-445d-9754-32f155f15a9c None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:07.894023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1c4fabf4-2d08-445d-9754-32f155f15a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:08.144024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 893/1750] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:22:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:08.216297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26215fb1-4848-4cc6-808e-ba0d8e91dd75 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:08.242532 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26215fb1-4848-4cc6-808e-ba0d8e91dd75 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:08.259700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d6f7-bb2f-43dd-8b37-d63bb88a60a0 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd763db99f51541b8a13ec718b6cdbc7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebea1c69f4d24bf78b360863b31a2e01', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:08.261457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d6f7-bb2f-43dd-8b37-d63bb88a60a0 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:08.273133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d6f7-bb2f-43dd-8b37-d63bb88a60a0 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:08.274871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d6f7-bb2f-43dd-8b37-d63bb88a60a0 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:08.276323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675d6f7-bb2f-43dd-8b37-d63bb88a60a0 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:08.280624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675d6f7-bb2f-43dd-8b37-d63bb88a60a0 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:08.286703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675d6f7-bb2f-43dd-8b37-d63bb88a60a0 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:08.330714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fabf4-2d08-445d-9754-32f155f15a9c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:08.341435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 858/1751] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:08.348530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4fabf4-2d08-445d-9754-32f155f15a9c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:08.378953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d675682-3c6d-413d-8ad3-e50a268df2dc tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd763db99f51541b8a13ec718b6cdbc7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebea1c69f4d24bf78b360863b31a2e01', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:08.379684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d675682-3c6d-413d-8ad3-e50a268df2dc tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:08.379977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d675682-3c6d-413d-8ad3-e50a268df2dc tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:08.380280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d675682-3c6d-413d-8ad3-e50a268df2dc tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:08.381021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d675682-3c6d-413d-8ad3-e50a268df2dc tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:08.383084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d675682-3c6d-413d-8ad3-e50a268df2dc tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:08.413225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:08.479537 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 894/1752] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:08 2022] POST /identity/v3/projects => generated 354 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:08.484311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d6f7-bb2f-43dd-8b37-d63bb88a60a0 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:08.491414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:08.498175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d6f7-bb2f-43dd-8b37-d63bb88a60a0 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:08.665082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d675682-3c6d-413d-8ad3-e50a268df2dc tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:08.666913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6d675682-3c6d-413d-8ad3-e50a268df2dc tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:08.748925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a5384-6ca7-4243-9421-3ae382c3ea49 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd763db99f51541b8a13ec718b6cdbc7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebea1c69f4d24bf78b360863b31a2e01', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:08.749635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a5384-6ca7-4243-9421-3ae382c3ea49 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:08.749923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a5384-6ca7-4243-9421-3ae382c3ea49 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:08.750277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a5384-6ca7-4243-9421-3ae382c3ea49 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:08.751030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a5384-6ca7-4243-9421-3ae382c3ea49 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:08.752618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a5384-6ca7-4243-9421-3ae382c3ea49 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:08.761078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a5384-6ca7-4243-9421-3ae382c3ea49 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:08.819449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 859/1753] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:08.875807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb238609-6828-488c-8a36-8ba15e714f29 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:08.876156 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb238609-6828-488c-8a36-8ba15e714f29 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:08.876382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb238609-6828-488c-8a36-8ba15e714f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:08.955249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d675682-3c6d-413d-8ad3-e50a268df2dc tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:08.974417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-cb238609-6828-488c-8a36-8ba15e714f29 None None] MFA Rules not processed for user `cabc5ecafe6d443c8459b8857a1e3242`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:08.975755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-cb238609-6828-488c-8a36-8ba15e714f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:08.981306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:08.982275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:08.982557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:08.982916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] PATH_INFO: `/v3/users/1c64ea0e22a64f56bd2e044edeb0afbd` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:08.984716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c64ea0e22a64f56bd2e044edeb0afbd)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:08.999366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:09.158212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c64ea0e22a64f56bd2e044edeb0afbd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.176024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c64ea0e22a64f56bd2e044edeb0afbd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.180452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c64ea0e22a64f56bd2e044edeb0afbd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.238939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c64ea0e22a64f56bd2e044edeb0afbd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.272644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 860/1754] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:09.279746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb238609-6828-488c-8a36-8ba15e714f29 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:09.285052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-cb238609-6828-488c-8a36-8ba15e714f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:09.285834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0f1ff0b9-d599-470f-9e8d-e7e814c6484d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c64ea0e22a64f56bd2e044edeb0afbd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.318151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 895/1755] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:08 2022] DELETE /identity/v3/users/1c64ea0e22a64f56bd2e044edeb0afbd => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:09.321214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47a5c-2192-4e0c-ac77-d9f6b66d5a38 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:09.324216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47a5c-2192-4e0c-ac77-d9f6b66d5a38 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:09.324411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb47a5c-2192-4e0c-ac77-d9f6b66d5a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:09.352866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb238609-6828-488c-8a36-8ba15e714f29 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:09.389994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3bb47a5c-2192-4e0c-ac77-d9f6b66d5a38 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:09.392746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3bb47a5c-2192-4e0c-ac77-d9f6b66d5a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:09.618702 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd763db99f51541b8a13ec718b6cdbc7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebea1c69f4d24bf78b360863b31a2e01', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:09.620015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:09.620573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:09.621153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] PATH_INFO: `/v3/projects/9e7cf703b5b14e74a2a50d8813209409` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:09.629125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e7cf703b5b14e74a2a50d8813209409)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:09.646753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:09.706620 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 896/1756] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:09.712902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb47a5c-2192-4e0c-ac77-d9f6b66d5a38 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:09.716521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3bb47a5c-2192-4e0c-ac77-d9f6b66d5a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:09.753991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb47a5c-2192-4e0c-ac77-d9f6b66d5a38 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:09.766225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:09.767458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:09.767956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:09.768248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] PATH_INFO: `/v3/users/20af48d99bc14c0497981db470e5605f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:09.783320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=20af48d99bc14c0497981db470e5605f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:09.787911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:09.788358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:09.799536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:09.838130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7cf703b5b14e74a2a50d8813209409', 'request_id': 'req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.858204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7cf703b5b14e74a2a50d8813209409', 'request_id': 'req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.880718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7cf703b5b14e74a2a50d8813209409', 'request_id': 'req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.924813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] The token cache is being invalidate because project 9e7cf703b5b14e74a2a50d8813209409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:09.925268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.928162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.946958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 861/1757] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:09 2022] DELETE /identity/v3/projects/9e7cf703b5b14e74a2a50d8813209409 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:09.954135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:09.964066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:09.973105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20af48d99bc14c0497981db470e5605f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.984054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20af48d99bc14c0497981db470e5605f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:09.985207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20af48d99bc14c0497981db470e5605f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:10.012639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20af48d99bc14c0497981db470e5605f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:10.059982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20af48d99bc14c0497981db470e5605f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:10.076058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 897/1758] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:09 2022] DELETE /identity/v3/users/20af48d99bc14c0497981db470e5605f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:10.085405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.091296 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:10.287462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673670a0-543d-4fe1-9fd8-c55f8778f34b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.301920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a23aeb-a8b2-42bf-8e7a-533b0df81aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.305244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a23aeb-a8b2-42bf-8e7a-533b0df81aba service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.306223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a23aeb-a8b2-42bf-8e7a-533b0df81aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.307697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a23aeb-a8b2-42bf-8e7a-533b0df81aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.315100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-60a23aeb-a8b2-42bf-8e7a-533b0df81aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:10.342349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58c76d-f4f9-4a13-aabb-90bf10cf9d02 tempest-VolumeQuotaClassesTest-1486631587 tempest-VolumeQuotaClassesTest-1486631587-project-admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.509457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a23aeb-a8b2-42bf-8e7a-533b0df81aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.511084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a23aeb-a8b2-42bf-8e7a-533b0df81aba service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.565758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 898/1759] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:10.573140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5830-87a4-4d13-98e5-c089b8c6b707 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.573464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5830-87a4-4d13-98e5-c089b8c6b707 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.573760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5830-87a4-4d13-98e5-c089b8c6b707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.626647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.627896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.628117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.628753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.630690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:10.642237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e27c5830-87a4-4d13-98e5-c089b8c6b707 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:10.643650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e27c5830-87a4-4d13-98e5-c089b8c6b707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:10.657605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.660337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.687281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 899/1760] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:10.735799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 862/1761] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:10.752474 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5830-87a4-4d13-98e5-c089b8c6b707 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.755955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e27c5830-87a4-4d13-98e5-c089b8c6b707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:10.787584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5830-87a4-4d13-98e5-c089b8c6b707 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.806963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef63a9-acbc-4232-b8e5-a2710d5759f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.807750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef63a9-acbc-4232-b8e5-a2710d5759f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.808077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef63a9-acbc-4232-b8e5-a2710d5759f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.816355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef63a9-acbc-4232-b8e5-a2710d5759f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.865264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef63a9-acbc-4232-b8e5-a2710d5759f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.868182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef63a9-acbc-4232-b8e5-a2710d5759f1 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.884615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.886681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:10.917541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2e931-d687-4952-bf2b-f678215eef6d service nova] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:10.918657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 900/1762] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:10.933593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef63a9-acbc-4232-b8e5-a2710d5759f1 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:10.935629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bfef63a9-acbc-4232-b8e5-a2710d5759f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:10.938239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:10.939181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:10.939492 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:10.942261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] PATH_INFO: `/v3/users/2116d6e5122e494e83db6074890b6e95` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:10.944569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2116d6e5122e494e83db6074890b6e95)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:10.948406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:10.999722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef63a9-acbc-4232-b8e5-a2710d5759f1 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:11.012926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509ede1-0570-415b-aff4-1f9c676b158b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:11.013609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509ede1-0570-415b-aff4-1f9c676b158b service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:11.013900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509ede1-0570-415b-aff4-1f9c676b158b service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:11.014176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509ede1-0570-415b-aff4-1f9c676b158b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:11.020186 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e509ede1-0570-415b-aff4-1f9c676b158b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:11.042046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:11.057285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:11.078077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2116d6e5122e494e83db6074890b6e95'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:11.080073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2116d6e5122e494e83db6074890b6e95'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:11.102225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2116d6e5122e494e83db6074890b6e95'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:11.104905 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2116d6e5122e494e83db6074890b6e95'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:11.127102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8af0a539-81fb-4802-8502-e9dfcab0a877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2116d6e5122e494e83db6074890b6e95'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:11.195361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 863/1763] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:10 2022] DELETE /identity/v3/users/2116d6e5122e494e83db6074890b6e95 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:11.200048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786e07b-d515-4dfe-ae00-6ece435d64a5 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:11.200346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786e07b-d515-4dfe-ae00-6ece435d64a5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:11.200632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786e07b-d515-4dfe-ae00-6ece435d64a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:11.253967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8786e07b-d515-4dfe-ae00-6ece435d64a5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:11.258282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8786e07b-d515-4dfe-ae00-6ece435d64a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:11.284981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509ede1-0570-415b-aff4-1f9c676b158b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:11.286876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509ede1-0570-415b-aff4-1f9c676b158b service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:11.312263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 901/1764] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:11.475647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 864/1765] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:11.543986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509ede1-0570-415b-aff4-1f9c676b158b service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:11.562475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509ede1-0570-415b-aff4-1f9c676b158b service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:11.727137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224a335-ee3d-43c9-b92e-adc9ccfe50df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:11.727841 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224a335-ee3d-43c9-b92e-adc9ccfe50df service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:11.728132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224a335-ee3d-43c9-b92e-adc9ccfe50df service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:11.728408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224a335-ee3d-43c9-b92e-adc9ccfe50df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:11.752326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224a335-ee3d-43c9-b92e-adc9ccfe50df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:11.754753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224a335-ee3d-43c9-b92e-adc9ccfe50df service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:11.803375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 902/1766] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:13.514436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786e07b-d515-4dfe-ae00-6ece435d64a5 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:13.516975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8786e07b-d515-4dfe-ae00-6ece435d64a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:13.559790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786e07b-d515-4dfe-ae00-6ece435d64a5 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:13.580981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:13.582326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.585790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.586830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] PATH_INFO: `/v3/projects/0ebbaae9bb0e41f3adac89fa8f3c8bf6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.592135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ebbaae9bb0e41f3adac89fa8f3c8bf6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:13.599021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:13.739595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebbaae9bb0e41f3adac89fa8f3c8bf6', 'request_id': 'req-7ca1d3a6-0689-4559-8e55-f83cd05db959'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:13.756441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebbaae9bb0e41f3adac89fa8f3c8bf6', 'request_id': 'req-7ca1d3a6-0689-4559-8e55-f83cd05db959'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:13.774930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebbaae9bb0e41f3adac89fa8f3c8bf6', 'request_id': 'req-7ca1d3a6-0689-4559-8e55-f83cd05db959'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:13.803037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] The token cache is being invalidate because project 0ebbaae9bb0e41f3adac89fa8f3c8bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:13.804214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:13.806535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca1d3a6-0689-4559-8e55-f83cd05db959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:13.812754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 865/1767] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:13 2022] DELETE /identity/v3/projects/0ebbaae9bb0e41f3adac89fa8f3c8bf6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:13.817407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5daba4-84ab-4c85-b734-734f89725d55 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:13.817899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5daba4-84ab-4c85-b734-734f89725d55 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:13.817995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5daba4-84ab-4c85-b734-734f89725d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:13.848842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2d5daba4-84ab-4c85-b734-734f89725d55 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:13.852866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2d5daba4-84ab-4c85-b734-734f89725d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:14.129440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 903/1768] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:14.145563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67342d-686e-4453-9df3-460fd171a278 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.152589 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67342d-686e-4453-9df3-460fd171a278 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.153639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67342d-686e-4453-9df3-460fd171a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.232451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-3a67342d-686e-4453-9df3-460fd171a278 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:14.238111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3a67342d-686e-4453-9df3-460fd171a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:14.256842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 866/1769] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:14.260479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5daba4-84ab-4c85-b734-734f89725d55 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.276368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5daba4-84ab-4c85-b734-734f89725d55 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.314695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b332f-821a-44b0-bd11-8c3eb3566a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.315422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b332f-821a-44b0-bd11-8c3eb3566a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.315712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b332f-821a-44b0-bd11-8c3eb3566a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.316019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b332f-821a-44b0-bd11-8c3eb3566a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.316738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b332f-821a-44b0-bd11-8c3eb3566a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:14.317052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b332f-821a-44b0-bd11-8c3eb3566a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.329709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b332f-821a-44b0-bd11-8c3eb3566a20 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.373900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 904/1770] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:14.378074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67342d-686e-4453-9df3-460fd171a278 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.412453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67342d-686e-4453-9df3-460fd171a278 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.449947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295070bd-63aa-4b49-8865-20457dad72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.464833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295070bd-63aa-4b49-8865-20457dad72bd admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.478054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295070bd-63aa-4b49-8865-20457dad72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.483197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295070bd-63aa-4b49-8865-20457dad72bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.483197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295070bd-63aa-4b49-8865-20457dad72bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.498481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295070bd-63aa-4b49-8865-20457dad72bd admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.598259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 867/1771] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:14 2022] POST /identity/v3/projects => generated 405 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:14.602124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b332f-821a-44b0-bd11-8c3eb3566a20 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.623191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b332f-821a-44b0-bd11-8c3eb3566a20 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.741094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.788896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda90f5c-5dd8-478f-a302-89e74024bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.789625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda90f5c-5dd8-478f-a302-89e74024bac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.789900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda90f5c-5dd8-478f-a302-89e74024bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.790368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda90f5c-5dd8-478f-a302-89e74024bac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.790886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda90f5c-5dd8-478f-a302-89e74024bac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.793417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda90f5c-5dd8-478f-a302-89e74024bac4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.849336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295070bd-63aa-4b49-8865-20457dad72bd admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.851628 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 905/1772] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:14 2022] POST /identity/v3/users => generated 303 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:14.865220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295070bd-63aa-4b49-8865-20457dad72bd admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.882457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c05b5-c292-4a55-8c47-116c98389572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.888361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c05b5-c292-4a55-8c47-116c98389572 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:14.888654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c05b5-c292-4a55-8c47-116c98389572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:14.888938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c05b5-c292-4a55-8c47-116c98389572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:14.889941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c05b5-c292-4a55-8c47-116c98389572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:14.891841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c05b5-c292-4a55-8c47-116c98389572 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:14.897360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:14.937031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda90f5c-5dd8-478f-a302-89e74024bac4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:14.938336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 868/1773] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:14.959111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda90f5c-5dd8-478f-a302-89e74024bac4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:14.999014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625e60-6dc2-4bec-a4a9-51205cbfa320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:14.999933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625e60-6dc2-4bec-a4a9-51205cbfa320 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:15.008015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625e60-6dc2-4bec-a4a9-51205cbfa320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:15.008529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625e60-6dc2-4bec-a4a9-51205cbfa320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:15.009470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a625e60-6dc2-4bec-a4a9-51205cbfa320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:15.011308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a625e60-6dc2-4bec-a4a9-51205cbfa320 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:15.040571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 906/1774] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:15.045604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c05b5-c292-4a55-8c47-116c98389572 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:15.064450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c05b5-c292-4a55-8c47-116c98389572 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:15.093284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcfdfd-a887-4752-89d3-f0da4e755c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:15.098138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcfdfd-a887-4752-89d3-f0da4e755c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:15.099988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcfdfd-a887-4752-89d3-f0da4e755c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:15.100292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcfdfd-a887-4752-89d3-f0da4e755c2a admin admin] PATH_INFO: `/v3/projects/f18c477119aa439e929d94336d5c08ed/users/d556c69fe3ff4b7798911024ea2f6ea8/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:15.174230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcfdfd-a887-4752-89d3-f0da4e755c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18c477119aa439e929d94336d5c08ed, user_id=d556c69fe3ff4b7798911024ea2f6ea8, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:15.183389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcfdfd-a887-4752-89d3-f0da4e755c2a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:15.225176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625e60-6dc2-4bec-a4a9-51205cbfa320 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:15.227143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0a625e60-6dc2-4bec-a4a9-51205cbfa320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:15.238893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 869/1775] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:15 2022] PUT /identity/v3/projects/f18c477119aa439e929d94336d5c08ed/users/d556c69fe3ff4b7798911024ea2f6ea8/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:15.241405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746107b-0764-42dc-b936-84d5076522ce None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:15.241752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746107b-0764-42dc-b936-84d5076522ce None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:15.250242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746107b-0764-42dc-b936-84d5076522ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:15.250884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625e60-6dc2-4bec-a4a9-51205cbfa320 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:15.333902 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a746107b-0764-42dc-b936-84d5076522ce None None] MFA Rules not processed for user `d556c69fe3ff4b7798911024ea2f6ea8`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:15.335618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a746107b-0764-42dc-b936-84d5076522ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:15.409763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:15.413595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:15.413595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:15.413595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] PATH_INFO: `/v3/projects/9a589c2aba6c448899f817b0f74b5971` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:15.422276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a589c2aba6c448899f817b0f74b5971)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:15.427597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:15.508908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 870/1776] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:15.509893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746107b-0764-42dc-b936-84d5076522ce None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:15.513373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a746107b-0764-42dc-b936-84d5076522ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:15.548525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746107b-0764-42dc-b936-84d5076522ce None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:15.561823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:15.568640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:15.569152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:15.569666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] PATH_INFO: `/v3/projects/6d6e9bf978414b9783ef3b7c4b806c85` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:15.574591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6e9bf978414b9783ef3b7c4b806c85)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:15.581001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:15.621411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a589c2aba6c448899f817b0f74b5971', 'request_id': 'req-4f74a830-1902-4f12-aa34-2c9442f61fd8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.632317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a589c2aba6c448899f817b0f74b5971', 'request_id': 'req-4f74a830-1902-4f12-aa34-2c9442f61fd8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.648898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a589c2aba6c448899f817b0f74b5971', 'request_id': 'req-4f74a830-1902-4f12-aa34-2c9442f61fd8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.683150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] The token cache is being invalidate because project 9a589c2aba6c448899f817b0f74b5971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:15.683714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.685017 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.686831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 907/1777] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:15 2022] DELETE /identity/v3/projects/9a589c2aba6c448899f817b0f74b5971 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:15.687782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:15.692011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:15.755072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6e9bf978414b9783ef3b7c4b806c85', 'request_id': 'req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.775998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6e9bf978414b9783ef3b7c4b806c85', 'request_id': 'req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.797773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6e9bf978414b9783ef3b7c4b806c85', 'request_id': 'req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.806569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:15.848067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] The token cache is being invalidate because project 6d6e9bf978414b9783ef3b7c4b806c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:15.848538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.849334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:15.852368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74a830-1902-4f12-aa34-2c9442f61fd8 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:15.853224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 871/1778] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:15 2022] DELETE /identity/v3/projects/6d6e9bf978414b9783ef3b7c4b806c85 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:15.854170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:15.856017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:16.001400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5885c64-8fd6-4efe-bf7a-66259eb129b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:16.002028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:16.021178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5885c64-8fd6-4efe-bf7a-66259eb129b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:16.022679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5885c64-8fd6-4efe-bf7a-66259eb129b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:16.023737 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5885c64-8fd6-4efe-bf7a-66259eb129b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:16.028404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5885c64-8fd6-4efe-bf7a-66259eb129b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:16.030694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5885c64-8fd6-4efe-bf7a-66259eb129b0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:16.081302 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdb589-7acc-4fd5-bcd1-bc033f5d0d8c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:16.094205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:16.097431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:16.097881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:16.098106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] PATH_INFO: `/v3/users/d763db99f51541b8a13ec718b6cdbc7d` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:16.101848 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d763db99f51541b8a13ec718b6cdbc7d)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:16.108286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:16.126913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 908/1779] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:15 2022] POST /identity/v3/projects => generated 405 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:16.128446 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5885c64-8fd6-4efe-bf7a-66259eb129b0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:16.131865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f5885c64-8fd6-4efe-bf7a-66259eb129b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:16.255120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd763db99f51541b8a13ec718b6cdbc7d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.256885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd763db99f51541b8a13ec718b6cdbc7d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.276272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd763db99f51541b8a13ec718b6cdbc7d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.278297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd763db99f51541b8a13ec718b6cdbc7d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.294163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd763db99f51541b8a13ec718b6cdbc7d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.311597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5885c64-8fd6-4efe-bf7a-66259eb129b0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:16.333225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:16.334510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:16.335043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:16.335568 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] PATH_INFO: `/v3/users/d0ef170d74ff47b5b149eaddc44f733e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:16.337142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ef170d74ff47b5b149eaddc44f733e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:16.339403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:16.341446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 872/1780] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:15 2022] DELETE /identity/v3/users/d763db99f51541b8a13ec718b6cdbc7d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:16.355644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:16.360139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:16.464966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ef170d74ff47b5b149eaddc44f733e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.481014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ef170d74ff47b5b149eaddc44f733e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.485551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ef170d74ff47b5b149eaddc44f733e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.499481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8510c-6892-483b-9dfd-3ac6752894a3 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:16.504758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ef170d74ff47b5b149eaddc44f733e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.509472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99862c89-485d-4f0d-aecd-68f5f9310d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:16.510409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99862c89-485d-4f0d-aecd-68f5f9310d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:16.510926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99862c89-485d-4f0d-aecd-68f5f9310d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:16.512228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99862c89-485d-4f0d-aecd-68f5f9310d75 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:16.513190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99862c89-485d-4f0d-aecd-68f5f9310d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:16.517202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99862c89-485d-4f0d-aecd-68f5f9310d75 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:16.547947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ef170d74ff47b5b149eaddc44f733e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:16.550536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:16.577600 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 873/1781] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:16 2022] POST /identity/v3/users => generated 309 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:16.580999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99862c89-485d-4f0d-aecd-68f5f9310d75 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:16.584230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-99862c89-485d-4f0d-aecd-68f5f9310d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:16.612156 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 909/1782] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:16 2022] DELETE /identity/v3/users/d0ef170d74ff47b5b149eaddc44f733e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:16.612355 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99862c89-485d-4f0d-aecd-68f5f9310d75 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:16.833631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:16.868909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490302e-037c-4e87-9929-77204e158cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:16.870225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490302e-037c-4e87-9929-77204e158cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:16.870805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490302e-037c-4e87-9929-77204e158cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:16.871309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490302e-037c-4e87-9929-77204e158cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:16.872476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490302e-037c-4e87-9929-77204e158cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:16.874934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490302e-037c-4e87-9929-77204e158cdd admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:16.910196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 874/1783] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:16.911433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:16.923132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf9be-91bf-47f2-b5c6-9aa27fd87d82 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:16.939962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cd7f7-487d-4f4e-a81c-c2f9dc8c7c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:16.941280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cd7f7-487d-4f4e-a81c-c2f9dc8c7c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:16.941785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cd7f7-487d-4f4e-a81c-c2f9dc8c7c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:16.942475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cd7f7-487d-4f4e-a81c-c2f9dc8c7c39 admin admin] PATH_INFO: `/v3/projects/61c904440acb4b5ba098cec31bd838e0/users/08d422055ca446f88a935b3caa0d7b6d/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:16.983932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cd7f7-487d-4f4e-a81c-c2f9dc8c7c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c904440acb4b5ba098cec31bd838e0, user_id=08d422055ca446f88a935b3caa0d7b6d, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:16.989481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cd7f7-487d-4f4e-a81c-c2f9dc8c7c39 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.015501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 910/1784] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:16 2022] PUT /identity/v3/projects/61c904440acb4b5ba098cec31bd838e0/users/08d422055ca446f88a935b3caa0d7b6d/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:17.016583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490302e-037c-4e87-9929-77204e158cdd admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.019159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cd7f7-487d-4f4e-a81c-c2f9dc8c7c39 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.019280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e490302e-037c-4e87-9929-77204e158cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:17.040574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490302e-037c-4e87-9929-77204e158cdd admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.098039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cd7f7-487d-4f4e-a81c-c2f9dc8c7c39 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.103116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f8f8f-a67c-4cd5-bcac-e0f891301adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.103839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f8f8f-a67c-4cd5-bcac-e0f891301adc admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.104132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f8f8f-a67c-4cd5-bcac-e0f891301adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.104640 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f8f8f-a67c-4cd5-bcac-e0f891301adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.105397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f8f8f-a67c-4cd5-bcac-e0f891301adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.107130 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f8f8f-a67c-4cd5-bcac-e0f891301adc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.122687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 911/1785] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:17.123861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f8f8f-a67c-4cd5-bcac-e0f891301adc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.147750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f8f8f-a67c-4cd5-bcac-e0f891301adc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.164261 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8749fe-db5b-4aa9-aab8-e508eb3193e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.164832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8749fe-db5b-4aa9-aab8-e508eb3193e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.165040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8749fe-db5b-4aa9-aab8-e508eb3193e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.165234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8749fe-db5b-4aa9-aab8-e508eb3193e1 admin admin] PATH_INFO: `/v3/projects/61c904440acb4b5ba098cec31bd838e0/users/08d422055ca446f88a935b3caa0d7b6d/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.167567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8749fe-db5b-4aa9-aab8-e508eb3193e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c904440acb4b5ba098cec31bd838e0, user_id=08d422055ca446f88a935b3caa0d7b6d, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.170319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8749fe-db5b-4aa9-aab8-e508eb3193e1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.209212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 912/1786] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:17 2022] PUT /identity/v3/projects/61c904440acb4b5ba098cec31bd838e0/users/08d422055ca446f88a935b3caa0d7b6d/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:17.210928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046f802-963a-4d98-afcb-1b6b8c02396f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.211227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046f802-963a-4d98-afcb-1b6b8c02396f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.211546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046f802-963a-4d98-afcb-1b6b8c02396f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.239689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.244331 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.244759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.247256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] PATH_INFO: `/v3/users/fe3f1558279448f3928ce66c8555c9c6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.252333 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3f1558279448f3928ce66c8555c9c6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.260003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.284522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d046f802-963a-4d98-afcb-1b6b8c02396f None None] MFA Rules not processed for user `08d422055ca446f88a935b3caa0d7b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:17.285621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d046f802-963a-4d98-afcb-1b6b8c02396f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:17.369736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3f1558279448f3928ce66c8555c9c6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:17.372917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3f1558279448f3928ce66c8555c9c6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:17.392496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3f1558279448f3928ce66c8555c9c6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:17.393761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3f1558279448f3928ce66c8555c9c6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:17.415558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3f1558279448f3928ce66c8555c9c6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:17.451527 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 913/1787] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:17.453827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259e92e-d3da-446e-9166-0b7006d94712 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.454155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259e92e-d3da-446e-9166-0b7006d94712 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.456891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259e92e-d3da-446e-9166-0b7006d94712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.480950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 875/1788] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:17 2022] DELETE /identity/v3/users/fe3f1558279448f3928ce66c8555c9c6 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:17.482232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.485515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:17.516629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0259e92e-d3da-446e-9166-0b7006d94712 None None] MFA Rules not processed for user `d619c0247a084d07941bd70c14b66b39`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:17.519871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0259e92e-d3da-446e-9166-0b7006d94712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:17.573251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5febf6-7f13-4d1a-baf4-1a05aefda558 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.577328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5377c0-4480-4d49-967a-3d81f3e5f14c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.578149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5377c0-4480-4d49-967a-3d81f3e5f14c service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.578551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5377c0-4480-4d49-967a-3d81f3e5f14c service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.578998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5377c0-4480-4d49-967a-3d81f3e5f14c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.610749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:17.662936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5377c0-4480-4d49-967a-3d81f3e5f14c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.664828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5377c0-4480-4d49-967a-3d81f3e5f14c service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.673311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:17.677342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 876/1789] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:17.679146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93096-59b6-4584-a7b2-ef8c98627112 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.679614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93096-59b6-4584-a7b2-ef8c98627112 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.679975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a93096-59b6-4584-a7b2-ef8c98627112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.702134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-95a93096-59b6-4584-a7b2-ef8c98627112 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:17.703658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-95a93096-59b6-4584-a7b2-ef8c98627112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:17.740902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 914/1790] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:17.886487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 877/1791] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:17.911015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259e92e-d3da-446e-9166-0b7006d94712 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.912555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0259e92e-d3da-446e-9166-0b7006d94712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:17.945144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259e92e-d3da-446e-9166-0b7006d94712 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:17.951774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:17.953219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:17.953725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:17.954363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] PATH_INFO: `/v3/users/d556c69fe3ff4b7798911024ea2f6ea8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:17.956164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d556c69fe3ff4b7798911024ea2f6ea8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:17.958381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:17.960594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93096-59b6-4584-a7b2-ef8c98627112 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:17.962203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-95a93096-59b6-4584-a7b2-ef8c98627112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:18.061203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd556c69fe3ff4b7798911024ea2f6ea8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.084505 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd556c69fe3ff4b7798911024ea2f6ea8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.086737 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd556c69fe3ff4b7798911024ea2f6ea8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.126988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd556c69fe3ff4b7798911024ea2f6ea8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.138040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a93096-59b6-4584-a7b2-ef8c98627112 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.142145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b901f8-3b19-4cbd-b145-4b4c03ebe157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:18.142872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b901f8-3b19-4cbd-b145-4b4c03ebe157 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.143125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b901f8-3b19-4cbd-b145-4b4c03ebe157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.143439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b901f8-3b19-4cbd-b145-4b4c03ebe157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.145557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a0b901f8-3b19-4cbd-b145-4b4c03ebe157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:18.171179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b901f8-3b19-4cbd-b145-4b4c03ebe157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:18.174854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b901f8-3b19-4cbd-b145-4b4c03ebe157 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:18.185252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd556c69fe3ff4b7798911024ea2f6ea8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.191306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 878/1792] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:22:18.201383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 915/1793] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:17 2022] DELETE /identity/v3/users/d556c69fe3ff4b7798911024ea2f6ea8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:18.203649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab2dc0-5ff8-4300-a0f2-da9c4aa6ea69 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.203941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab2dc0-5ff8-4300-a0f2-da9c4aa6ea69 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.204223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab2dc0-5ff8-4300-a0f2-da9c4aa6ea69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.231889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7cab2dc0-5ff8-4300-a0f2-da9c4aa6ea69 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:18.233121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7cab2dc0-5ff8-4300-a0f2-da9c4aa6ea69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:18.339993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 879/1794] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:18.376224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:18.377727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:18.519693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676e32d-928c-48a9-90aa-5b6d1e73f237 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.535436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962abcb-d803-44c8-9b9d-fa1d2e90dc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:18.536117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962abcb-d803-44c8-9b9d-fa1d2e90dc4d service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.536405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962abcb-d803-44c8-9b9d-fa1d2e90dc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.536686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962abcb-d803-44c8-9b9d-fa1d2e90dc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.549609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962abcb-d803-44c8-9b9d-fa1d2e90dc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:18.551194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962abcb-d803-44c8-9b9d-fa1d2e90dc4d service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:18.563673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 916/1795] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:18.663377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab2dc0-5ff8-4300-a0f2-da9c4aa6ea69 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:18.665294 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7cab2dc0-5ff8-4300-a0f2-da9c4aa6ea69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:18.681384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:18.691270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab2dc0-5ff8-4300-a0f2-da9c4aa6ea69 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.697505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:18.698968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.699308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.699923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] PATH_INFO: `/v3/projects/ea949e484f4d4509a197513a94da1fde` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.701702 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea949e484f4d4509a197513a94da1fde)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:18.703938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:18.843762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962abcb-d803-44c8-9b9d-fa1d2e90dc4d service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:18.845270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8962abcb-d803-44c8-9b9d-fa1d2e90dc4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:18.867479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea949e484f4d4509a197513a94da1fde', 'request_id': 'req-9428f593-9b0f-48e5-95a9-975517ead52d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.872109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962abcb-d803-44c8-9b9d-fa1d2e90dc4d service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:18.880963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea949e484f4d4509a197513a94da1fde', 'request_id': 'req-9428f593-9b0f-48e5-95a9-975517ead52d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.893173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea949e484f4d4509a197513a94da1fde', 'request_id': 'req-9428f593-9b0f-48e5-95a9-975517ead52d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.908643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] The token cache is being invalidate because project ea949e484f4d4509a197513a94da1fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:18.908988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.910297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9428f593-9b0f-48e5-95a9-975517ead52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:18.912705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 880/1796] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:18 2022] DELETE /identity/v3/projects/ea949e484f4d4509a197513a94da1fde => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:18.914179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2faeb6-8b3f-43fb-b35a-29541973fb6a None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.915124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2faeb6-8b3f-43fb-b35a-29541973fb6a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.915422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2faeb6-8b3f-43fb-b35a-29541973fb6a None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.917472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 881/1797] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:18.919643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce38f6-38b4-47ad-8b42-b7565cc12f9f None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:18.919983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce38f6-38b4-47ad-8b42-b7565cc12f9f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:18.920263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce38f6-38b4-47ad-8b42-b7565cc12f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:18.955330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-11ce38f6-38b4-47ad-8b42-b7565cc12f9f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:18.956790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-11ce38f6-38b4-47ad-8b42-b7565cc12f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:19.002653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.003622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.004091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.004534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] PATH_INFO: `/v3/projects/ebea1c69f4d24bf78b360863b31a2e01` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.014282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebea1c69f4d24bf78b360863b31a2e01)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.016297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.024652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:19.137946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 882/1798] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:19.142126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606fd6b-3533-4dc0-8b07-05a9e6ece9fc None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.144492 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606fd6b-3533-4dc0-8b07-05a9e6ece9fc None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.144788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606fd6b-3533-4dc0-8b07-05a9e6ece9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.147761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebea1c69f4d24bf78b360863b31a2e01', 'request_id': 'req-3a7d1673-a43a-4779-9777-9ac2a8fc107d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:19.165956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebea1c69f4d24bf78b360863b31a2e01', 'request_id': 'req-3a7d1673-a43a-4779-9777-9ac2a8fc107d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:19.197397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebea1c69f4d24bf78b360863b31a2e01', 'request_id': 'req-3a7d1673-a43a-4779-9777-9ac2a8fc107d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:19.213453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d606fd6b-3533-4dc0-8b07-05a9e6ece9fc None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:19.219222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d606fd6b-3533-4dc0-8b07-05a9e6ece9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:19.231128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] The token cache is being invalidate because project ebea1c69f4d24bf78b360863b31a2e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:19.231483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:19.233164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a7d1673-a43a-4779-9777-9ac2a8fc107d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:19.237153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 917/1799] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:18 2022] DELETE /identity/v3/projects/ebea1c69f4d24bf78b360863b31a2e01 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:19.244040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1339d-c49d-47c2-b8c0-ed9682ae212d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.244618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1339d-c49d-47c2-b8c0-ed9682ae212d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.244903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1339d-c49d-47c2-b8c0-ed9682ae212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.284874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f3a1339d-c49d-47c2-b8c0-ed9682ae212d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:19.288492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f3a1339d-c49d-47c2-b8c0-ed9682ae212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:19.384878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 883/1800] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:22:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:19.386855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ddf0-c747-4f64-b734-ea6af49c4acb None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.387147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ddf0-c747-4f64-b734-ea6af49c4acb None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.387448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ddf0-c747-4f64-b734-ea6af49c4acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.435973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 918/1801] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:19.436339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e862ddf0-c747-4f64-b734-ea6af49c4acb None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:19.437566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e862ddf0-c747-4f64-b734-ea6af49c4acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:19.438232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1339d-c49d-47c2-b8c0-ed9682ae212d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.454057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1339d-c49d-47c2-b8c0-ed9682ae212d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.465721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 884/1802] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:19.467404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474c96e-ac05-4218-a616-9527470ba17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.468279 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643d7d-5af5-4447-828b-4258e0f9330c None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.468403 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474c96e-ac05-4218-a616-9527470ba17f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.468487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643d7d-5af5-4447-828b-4258e0f9330c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.468575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474c96e-ac05-4218-a616-9527470ba17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.468651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a643d7d-5af5-4447-828b-4258e0f9330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.468719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474c96e-ac05-4218-a616-9527470ba17f admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.470631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474c96e-ac05-4218-a616-9527470ba17f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:19.471638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474c96e-ac05-4218-a616-9527470ba17f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.474269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474c96e-ac05-4218-a616-9527470ba17f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.507474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7a643d7d-5af5-4447-828b-4258e0f9330c None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:19.508715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7a643d7d-5af5-4447-828b-4258e0f9330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:19.516247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 919/1803] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:19.519923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474c96e-ac05-4218-a616-9527470ba17f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.532561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 885/1804] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:19.533276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643d7d-5af5-4447-828b-4258e0f9330c None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.543000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474c96e-ac05-4218-a616-9527470ba17f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.543218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a643d7d-5af5-4447-828b-4258e0f9330c None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.548826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cb242-c8b3-4876-9630-d1bcdac49370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.548987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ba19c-0688-4d14-ac1b-cf302da0dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.549609 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ba19c-0688-4d14-ac1b-cf302da0dd2a admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.549813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cb242-c8b3-4876-9630-d1bcdac49370 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.549897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ba19c-0688-4d14-ac1b-cf302da0dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.550125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cb242-c8b3-4876-9630-d1bcdac49370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.550221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ba19c-0688-4d14-ac1b-cf302da0dd2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.550402 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cb242-c8b3-4876-9630-d1bcdac49370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.550871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ba19c-0688-4d14-ac1b-cf302da0dd2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:19.551181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ba19c-0688-4d14-ac1b-cf302da0dd2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.552023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cb242-c8b3-4876-9630-d1bcdac49370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.552827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ba19c-0688-4d14-ac1b-cf302da0dd2a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.554707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:19.555449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cb242-c8b3-4876-9630-d1bcdac49370 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.575490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 886/1805] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:19.577462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ba19c-0688-4d14-ac1b-cf302da0dd2a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.608019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ba19c-0688-4d14-ac1b-cf302da0dd2a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.616393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbcdbd-8433-4d92-8b8b-85ab89cad255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.617118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbcdbd-8433-4d92-8b8b-85ab89cad255 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.617407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbcdbd-8433-4d92-8b8b-85ab89cad255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.617686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbcdbd-8433-4d92-8b8b-85ab89cad255 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.618448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbcdbd-8433-4d92-8b8b-85ab89cad255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.621128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbcdbd-8433-4d92-8b8b-85ab89cad255 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.624717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 920/1806] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:19 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:19.628236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cb242-c8b3-4876-9630-d1bcdac49370 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.666503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 887/1807] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:19 2022] POST /identity/v3/projects => generated 363 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:19.669083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbcdbd-8433-4d92-8b8b-85ab89cad255 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.707894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:19.713558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cb242-c8b3-4876-9630-d1bcdac49370 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.773312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbcdbd-8433-4d92-8b8b-85ab89cad255 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.780623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25d8fa-6000-42a2-a90a-4c28e7ed226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.781685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d8fa-6000-42a2-a90a-4c28e7ed226d admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.782121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d8fa-6000-42a2-a90a-4c28e7ed226d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.782405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d8fa-6000-42a2-a90a-4c28e7ed226d admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.783176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25d8fa-6000-42a2-a90a-4c28e7ed226d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.785340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25d8fa-6000-42a2-a90a-4c28e7ed226d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.860927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44466fc-3373-4745-9bcd-21252b26473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.861616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44466fc-3373-4745-9bcd-21252b26473e admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.861906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44466fc-3373-4745-9bcd-21252b26473e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.862180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44466fc-3373-4745-9bcd-21252b26473e admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.862881 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44466fc-3373-4745-9bcd-21252b26473e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.864839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44466fc-3373-4745-9bcd-21252b26473e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.866120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 888/1808] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:19 2022] POST /identity/v3/users => generated 282 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:19.867552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25d8fa-6000-42a2-a90a-4c28e7ed226d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.872347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-cf25d8fa-6000-42a2-a90a-4c28e7ed226d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:19.904655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 921/1809] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:19 2022] POST /identity/v3/users => generated 285 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:19.905950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44466fc-3373-4745-9bcd-21252b26473e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:19.934884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44466fc-3373-4745-9bcd-21252b26473e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:19.949125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69ebf-aeda-451b-8ce3-67c525f3613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:19.950112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69ebf-aeda-451b-8ce3-67c525f3613a admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:19.950660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69ebf-aeda-451b-8ce3-67c525f3613a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:19.951122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e69ebf-aeda-451b-8ce3-67c525f3613a admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:19.952079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69ebf-aeda-451b-8ce3-67c525f3613a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:19.953916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e69ebf-aeda-451b-8ce3-67c525f3613a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:19.977941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 922/1810] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:19.979184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69ebf-aeda-451b-8ce3-67c525f3613a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.001494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e69ebf-aeda-451b-8ce3-67c525f3613a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.021694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a8ea9-eb07-4179-b543-240f147552ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.023052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a8ea9-eb07-4179-b543-240f147552ee admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.023585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a8ea9-eb07-4179-b543-240f147552ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.024088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a8ea9-eb07-4179-b543-240f147552ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.025046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a8ea9-eb07-4179-b543-240f147552ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.027753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a8ea9-eb07-4179-b543-240f147552ee admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.050916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 923/1811] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:20.055815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a8ea9-eb07-4179-b543-240f147552ee admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.067372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25d8fa-6000-42a2-a90a-4c28e7ed226d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.068997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a8ea9-eb07-4179-b543-240f147552ee admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.075917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11f5e-a765-4be2-9074-6371763dcbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.076863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11f5e-a765-4be2-9074-6371763dcbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.077328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11f5e-a765-4be2-9074-6371763dcbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.077811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee11f5e-a765-4be2-9074-6371763dcbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.078733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee11f5e-a765-4be2-9074-6371763dcbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.080538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee11f5e-a765-4be2-9074-6371763dcbd5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.083224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d8955-0d64-4444-877f-6f65cf700ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.083959 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8955-0d64-4444-877f-6f65cf700ad1 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.084246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8955-0d64-4444-877f-6f65cf700ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.084524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8955-0d64-4444-877f-6f65cf700ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.102706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 924/1812] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:20.103714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11f5e-a765-4be2-9074-6371763dcbd5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.105132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d8955-0d64-4444-877f-6f65cf700ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.107025 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d8955-0d64-4444-877f-6f65cf700ad1 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.107149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0ee11f5e-a765-4be2-9074-6371763dcbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:20.143263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 889/1813] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:20.144096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d8955-0d64-4444-877f-6f65cf700ad1 service nova] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.155890 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee11f5e-a765-4be2-9074-6371763dcbd5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.172098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d8955-0d64-4444-877f-6f65cf700ad1 service nova] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.182990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e93165-6507-460c-a2a1-2393953c10b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.183702 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e93165-6507-460c-a2a1-2393953c10b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.185306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e93165-6507-460c-a2a1-2393953c10b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.185594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e93165-6507-460c-a2a1-2393953c10b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.186355 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e93165-6507-460c-a2a1-2393953c10b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.194592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e93165-6507-460c-a2a1-2393953c10b0 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.205190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.208412 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.215807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.217872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] PATH_INFO: `/v3/projects/f18c477119aa439e929d94336d5c08ed` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.218652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 890/1814] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:20.219536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e93165-6507-460c-a2a1-2393953c10b0 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.224411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18c477119aa439e929d94336d5c08ed)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.237499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.245274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e93165-6507-460c-a2a1-2393953c10b0 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.254247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538001a-f831-411f-b24f-098cf70502ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.255159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538001a-f831-411f-b24f-098cf70502ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.255473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538001a-f831-411f-b24f-098cf70502ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.256055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538001a-f831-411f-b24f-098cf70502ae admin admin] PATH_INFO: `/v3/projects/ed2f8c20575d4a8283e956b60b7cac5b/users/1697892c0d9e43718c4cd15017eeb48f/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.275555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538001a-f831-411f-b24f-098cf70502ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2f8c20575d4a8283e956b60b7cac5b, user_id=1697892c0d9e43718c4cd15017eeb48f, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.280307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538001a-f831-411f-b24f-098cf70502ae admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.317336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 891/1815] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:20 2022] PUT /identity/v3/projects/ed2f8c20575d4a8283e956b60b7cac5b/users/1697892c0d9e43718c4cd15017eeb48f/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:20.321389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538001a-f831-411f-b24f-098cf70502ae admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.328618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f538001a-f831-411f-b24f-098cf70502ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:20.380618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:20.389007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18c477119aa439e929d94336d5c08ed', 'request_id': 'req-5464dd05-e0ca-4541-a210-c0f5f2006191'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.411850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18c477119aa439e929d94336d5c08ed', 'request_id': 'req-5464dd05-e0ca-4541-a210-c0f5f2006191'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.419792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18c477119aa439e929d94336d5c08ed', 'request_id': 'req-5464dd05-e0ca-4541-a210-c0f5f2006191'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.448048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] The token cache is being invalidate because project f18c477119aa439e929d94336d5c08ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:20.449571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.450852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.454639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 925/1816] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:20 2022] DELETE /identity/v3/projects/f18c477119aa439e929d94336d5c08ed => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:20.461308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.464226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:20.511196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538001a-f831-411f-b24f-098cf70502ae admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.586852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:20.623781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464dd05-e0ca-4541-a210-c0f5f2006191 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:20.629317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713e7f1-624a-45f1-860e-fcf9fa3b1046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.630414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:20.631128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e7f1-624a-45f1-860e-fcf9fa3b1046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.631568 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e7f1-624a-45f1-860e-fcf9fa3b1046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.631960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e7f1-624a-45f1-860e-fcf9fa3b1046 admin admin] PATH_INFO: `/v3/projects/c374a62f8ddf46a9976b40c7f1bac4fc/users/7d68536f19544195a9a593a48c9a9e1e/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.632400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.632836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.633263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] PATH_INFO: `/v3/projects/8ce4017322bc451ebcf9a7fbdeecf903` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.637143 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce4017322bc451ebcf9a7fbdeecf903)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.639563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.668519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713e7f1-624a-45f1-860e-fcf9fa3b1046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c374a62f8ddf46a9976b40c7f1bac4fc, user_id=7d68536f19544195a9a593a48c9a9e1e, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:20.674770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713e7f1-624a-45f1-860e-fcf9fa3b1046 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:20.697787 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 926/1817] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:20 2022] PUT /identity/v3/projects/c374a62f8ddf46a9976b40c7f1bac4fc/users/7d68536f19544195a9a593a48c9a9e1e/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:20.699968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c445d6-6439-4160-a5f4-fc67c8eb6b20 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.700265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c445d6-6439-4160-a5f4-fc67c8eb6b20 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.700546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c445d6-6439-4160-a5f4-fc67c8eb6b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.743244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b9c445d6-6439-4160-a5f4-fc67c8eb6b20 None None] MFA Rules not processed for user `1697892c0d9e43718c4cd15017eeb48f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:20.746335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b9c445d6-6439-4160-a5f4-fc67c8eb6b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:20.795858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce4017322bc451ebcf9a7fbdeecf903', 'request_id': 'req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.809041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce4017322bc451ebcf9a7fbdeecf903', 'request_id': 'req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.830283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce4017322bc451ebcf9a7fbdeecf903', 'request_id': 'req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.849558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] The token cache is being invalidate because project 8ce4017322bc451ebcf9a7fbdeecf903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:20.849856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.856092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:20.862578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 892/1818] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:20 2022] DELETE /identity/v3/projects/8ce4017322bc451ebcf9a7fbdeecf903 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:20.862578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:20.862578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:20.863992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 927/1819] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:20.865584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de491cc5-d129-4716-b0cf-834eeda1d1d9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:20.865885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de491cc5-d129-4716-b0cf-834eeda1d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:20.866544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de491cc5-d129-4716-b0cf-834eeda1d1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:20.913196 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-de491cc5-d129-4716-b0cf-834eeda1d1d9 None None] MFA Rules not processed for user `7d68536f19544195a9a593a48c9a9e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:20.918012 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-de491cc5-d129-4716-b0cf-834eeda1d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:21.019040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:21.064466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 928/1820] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:21.065613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de491cc5-d129-4716-b0cf-834eeda1d1d9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.066988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-de491cc5-d129-4716-b0cf-834eeda1d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:21.076284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898a0e5-8037-486f-8c8b-6a7abdafdbd7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.098624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.100356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de491cc5-d129-4716-b0cf-834eeda1d1d9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.100934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.101328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.101618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] PATH_INFO: `/v3/users/08d422055ca446f88a935b3caa0d7b6d` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.106826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d422055ca446f88a935b3caa0d7b6d)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.108110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.109001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.109368 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.109727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.110081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] PATH_INFO: `/v3/users/e756a131824643a39a86713b2be35edd` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.111662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e756a131824643a39a86713b2be35edd)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.113716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.227699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d422055ca446f88a935b3caa0d7b6d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.233771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d422055ca446f88a935b3caa0d7b6d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.240138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:21.251764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d422055ca446f88a935b3caa0d7b6d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.252505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d422055ca446f88a935b3caa0d7b6d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.257845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e756a131824643a39a86713b2be35edd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.270954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d422055ca446f88a935b3caa0d7b6d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.282095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e756a131824643a39a86713b2be35edd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.283293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e756a131824643a39a86713b2be35edd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.300966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e756a131824643a39a86713b2be35edd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.304554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 893/1821] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:20 2022] DELETE /identity/v3/users/08d422055ca446f88a935b3caa0d7b6d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:21.305849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.308405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:21.319969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-22117edb-6ee1-4caa-bc27-1977b98d00a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e756a131824643a39a86713b2be35edd'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:21.336424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 929/1822] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:21 2022] DELETE /identity/v3/users/e756a131824643a39a86713b2be35edd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:21.340426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933a578-31bf-4379-aae3-f32d76b6eaf6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.340728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933a578-31bf-4379-aae3-f32d76b6eaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.341006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933a578-31bf-4379-aae3-f32d76b6eaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.380317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a933a578-31bf-4379-aae3-f32d76b6eaf6 None None] MFA Rules not processed for user `cabc5ecafe6d443c8459b8857a1e3242`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:21.381697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a933a578-31bf-4379-aae3-f32d76b6eaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:21.440925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b56b68-e021-4115-9cab-c04d6b8b891e admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.504635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 930/1823] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:21.505713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933a578-31bf-4379-aae3-f32d76b6eaf6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.507004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a933a578-31bf-4379-aae3-f32d76b6eaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:21.515031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8735-1a19-4a48-99dd-dd15300276b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.515911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8735-1a19-4a48-99dd-dd15300276b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.516117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8735-1a19-4a48-99dd-dd15300276b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.516521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8735-1a19-4a48-99dd-dd15300276b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.517097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a8735-1a19-4a48-99dd-dd15300276b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.520607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a8735-1a19-4a48-99dd-dd15300276b9 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.525834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933a578-31bf-4379-aae3-f32d76b6eaf6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.533312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afec04-f4c6-4659-a937-272e6e8b96c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.534535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afec04-f4c6-4659-a937-272e6e8b96c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.534982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afec04-f4c6-4659-a937-272e6e8b96c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.535355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afec04-f4c6-4659-a937-272e6e8b96c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.536572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afec04-f4c6-4659-a937-272e6e8b96c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.538652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afec04-f4c6-4659-a937-272e6e8b96c0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.565652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:21.589733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 894/1824] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:21 2022] POST /identity/v3/projects => generated 367 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:21.590854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8735-1a19-4a48-99dd-dd15300276b9 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.593023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-328a8735-1a19-4a48-99dd-dd15300276b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:21.597562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 931/1825] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:21 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:21.602480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afec04-f4c6-4659-a937-272e6e8b96c0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.692240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8735-1a19-4a48-99dd-dd15300276b9 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.701300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d9c7a-7ac4-464f-ba24-01b3a5a22120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.702084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d9c7a-7ac4-464f-ba24-01b3a5a22120 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.702545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d9c7a-7ac4-464f-ba24-01b3a5a22120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.702832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d9c7a-7ac4-464f-ba24-01b3a5a22120 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.703679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d9c7a-7ac4-464f-ba24-01b3a5a22120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.706248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d9c7a-7ac4-464f-ba24-01b3a5a22120 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.712443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afec04-f4c6-4659-a937-272e6e8b96c0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.718531 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d95c95-e39e-4c5f-89d9-3fed69dd9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.719474 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95c95-e39e-4c5f-89d9-3fed69dd9882 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.719899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95c95-e39e-4c5f-89d9-3fed69dd9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.720312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95c95-e39e-4c5f-89d9-3fed69dd9882 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.721801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d95c95-e39e-4c5f-89d9-3fed69dd9882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.724260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d95c95-e39e-4c5f-89d9-3fed69dd9882 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.744086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 895/1826] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:21 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:21.747640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d9c7a-7ac4-464f-ba24-01b3a5a22120 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.751837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 932/1827] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:21 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:21.755122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d95c95-e39e-4c5f-89d9-3fed69dd9882 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.769863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d95c95-e39e-4c5f-89d9-3fed69dd9882 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.776784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262a9f1-de33-4800-a842-18f2303d7d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.777481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262a9f1-de33-4800-a842-18f2303d7d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.777775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262a9f1-de33-4800-a842-18f2303d7d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.778036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262a9f1-de33-4800-a842-18f2303d7d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.778780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262a9f1-de33-4800-a842-18f2303d7d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.780434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262a9f1-de33-4800-a842-18f2303d7d2e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.785670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d9c7a-7ac4-464f-ba24-01b3a5a22120 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.802553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713df4-6f5b-42e0-b31e-4abe48b225bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.803399 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713df4-6f5b-42e0-b31e-4abe48b225bb admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.803904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 933/1828] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:21.804999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713df4-6f5b-42e0-b31e-4abe48b225bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.805296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c713df4-6f5b-42e0-b31e-4abe48b225bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.809349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c713df4-6f5b-42e0-b31e-4abe48b225bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.812962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c713df4-6f5b-42e0-b31e-4abe48b225bb admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.821407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262a9f1-de33-4800-a842-18f2303d7d2e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.849816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 896/1829] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:21.850773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713df4-6f5b-42e0-b31e-4abe48b225bb admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:21.853599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262a9f1-de33-4800-a842-18f2303d7d2e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.867642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731625b-bc59-45e3-8f36-a2c720359a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.871148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731625b-bc59-45e3-8f36-a2c720359a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.871643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731625b-bc59-45e3-8f36-a2c720359a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.872077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731625b-bc59-45e3-8f36-a2c720359a4c admin admin] PATH_INFO: `/v3/projects/5226022863d14a78ae19b74bde021e50/users/270cca5fa44a437e91ef3749f782f9e9/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.878449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c713df4-6f5b-42e0-b31e-4abe48b225bb admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:21.892849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0cb72-3eeb-4d71-84f1-41d8697611f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:21.894904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0cb72-3eeb-4d71-84f1-41d8697611f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:21.896103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0cb72-3eeb-4d71-84f1-41d8697611f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:21.896489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0cb72-3eeb-4d71-84f1-41d8697611f7 admin admin] PATH_INFO: `/v3/projects/c1ea2e117e5149eb9608335d32b8a50a/users/c024661b88c943df869f23d6f0bbf2eb/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:21.919218 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731625b-bc59-45e3-8f36-a2c720359a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5226022863d14a78ae19b74bde021e50, user_id=270cca5fa44a437e91ef3749f782f9e9, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.925926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731625b-bc59-45e3-8f36-a2c720359a4c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.932663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0cb72-3eeb-4d71-84f1-41d8697611f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ea2e117e5149eb9608335d32b8a50a, user_id=c024661b88c943df869f23d6f0bbf2eb, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:21.935453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:21.955032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0cb72-3eeb-4d71-84f1-41d8697611f7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:21.960579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 934/1830] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:21 2022] PUT /identity/v3/projects/5226022863d14a78ae19b74bde021e50/users/270cca5fa44a437e91ef3749f782f9e9/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:21.962867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731625b-bc59-45e3-8f36-a2c720359a4c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:22.011498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 897/1831] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:21 2022] PUT /identity/v3/projects/c1ea2e117e5149eb9608335d32b8a50a/users/c024661b88c943df869f23d6f0bbf2eb/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:22.018897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0cb72-3eeb-4d71-84f1-41d8697611f7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:22.205981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0cb72-3eeb-4d71-84f1-41d8697611f7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:22.221367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731625b-bc59-45e3-8f36-a2c720359a4c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:22.224014 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9575cb-cec4-42ee-ab3b-7ca0def2581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:22.224855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9575cb-cec4-42ee-ab3b-7ca0def2581b admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.225142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9575cb-cec4-42ee-ab3b-7ca0def2581b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.226295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9575cb-cec4-42ee-ab3b-7ca0def2581b admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.227466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9575cb-cec4-42ee-ab3b-7ca0def2581b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:22.231548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9575cb-cec4-42ee-ab3b-7ca0def2581b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:22.235975 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ca91-d647-494a-a1a0-e8685b74826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:22.236914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ca91-d647-494a-a1a0-e8685b74826a admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.237203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ca91-d647-494a-a1a0-e8685b74826a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.237487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ca91-d647-494a-a1a0-e8685b74826a admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.238213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9ca91-d647-494a-a1a0-e8685b74826a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:22.240370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9ca91-d647-494a-a1a0-e8685b74826a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:22.258814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 898/1832] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:22.266484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9575cb-cec4-42ee-ab3b-7ca0def2581b admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:22.275918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 935/1833] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:22.280627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ca91-d647-494a-a1a0-e8685b74826a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:22.292779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9575cb-cec4-42ee-ab3b-7ca0def2581b admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:22.304197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ca91-d647-494a-a1a0-e8685b74826a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:22.305199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db759985-26f4-4aee-9b48-ea41ce571b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:22.306102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db759985-26f4-4aee-9b48-ea41ce571b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.307172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db759985-26f4-4aee-9b48-ea41ce571b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.320347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db759985-26f4-4aee-9b48-ea41ce571b1c admin admin] PATH_INFO: `/v3/projects/c1ea2e117e5149eb9608335d32b8a50a/users/c024661b88c943df869f23d6f0bbf2eb/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.325871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db759985-26f4-4aee-9b48-ea41ce571b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ea2e117e5149eb9608335d32b8a50a, user_id=c024661b88c943df869f23d6f0bbf2eb, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:22.329644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899505ca-0d2f-4404-8d06-69e394074eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:22.330563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899505ca-0d2f-4404-8d06-69e394074eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.330846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899505ca-0d2f-4404-8d06-69e394074eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.331123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899505ca-0d2f-4404-8d06-69e394074eaa admin admin] PATH_INFO: `/v3/projects/5226022863d14a78ae19b74bde021e50/users/270cca5fa44a437e91ef3749f782f9e9/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.333649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db759985-26f4-4aee-9b48-ea41ce571b1c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:22.338137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899505ca-0d2f-4404-8d06-69e394074eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5226022863d14a78ae19b74bde021e50, user_id=270cca5fa44a437e91ef3749f782f9e9, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:22.343608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899505ca-0d2f-4404-8d06-69e394074eaa admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:22.371361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 899/1834] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:22 2022] PUT /identity/v3/projects/c1ea2e117e5149eb9608335d32b8a50a/users/c024661b88c943df869f23d6f0bbf2eb/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:22.372361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db759985-26f4-4aee-9b48-ea41ce571b1c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:22.378678 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-db759985-26f4-4aee-9b48-ea41ce571b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:22.383979 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 936/1835] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:22 2022] PUT /identity/v3/projects/5226022863d14a78ae19b74bde021e50/users/270cca5fa44a437e91ef3749f782f9e9/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:22.385984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396903-51e5-425d-97c3-3d629fd0a89c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.386280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396903-51e5-425d-97c3-3d629fd0a89c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.386564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396903-51e5-425d-97c3-3d629fd0a89c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.387982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 937/1836] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:22.389080 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1f9a-4fdd-4f7a-b26f-cf4b840edfa1 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.389363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1f9a-4fdd-4f7a-b26f-cf4b840edfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.389636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf1f9a-4fdd-4f7a-b26f-cf4b840edfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.432026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5dbf1f9a-4fdd-4f7a-b26f-cf4b840edfa1 None None] MFA Rules not processed for user `c024661b88c943df869f23d6f0bbf2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:22.433978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5dbf1f9a-4fdd-4f7a-b26f-cf4b840edfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:22.507773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:22.546639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db759985-26f4-4aee-9b48-ea41ce571b1c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:22.555324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 938/1837] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:22.558755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fedbf-60a4-412e-94c1-97d5d7628c7f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.559052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fedbf-60a4-412e-94c1-97d5d7628c7f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.559330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fedbf-60a4-412e-94c1-97d5d7628c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.593205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-659fedbf-60a4-412e-94c1-97d5d7628c7f None None] MFA Rules not processed for user `270cca5fa44a437e91ef3749f782f9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:22.594442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-659fedbf-60a4-412e-94c1-97d5d7628c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:22.646899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:22.648402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.648802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.649400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] PATH_INFO: `/v3/projects/61c904440acb4b5ba098cec31bd838e0` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.650508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c904440acb4b5ba098cec31bd838e0)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:22.656275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:22.663469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:22.697350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 939/1838] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:22.699809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3106fa5-051a-4e92-941c-978664ed90e7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.700566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3106fa5-051a-4e92-941c-978664ed90e7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.700949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3106fa5-051a-4e92-941c-978664ed90e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.729747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d3106fa5-051a-4e92-941c-978664ed90e7 None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:22.730978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d3106fa5-051a-4e92-941c-978664ed90e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:22.748493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c904440acb4b5ba098cec31bd838e0', 'request_id': 'req-b4b6b0b4-d962-4c79-b047-e4a4ee882816'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:22.759636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c904440acb4b5ba098cec31bd838e0', 'request_id': 'req-b4b6b0b4-d962-4c79-b047-e4a4ee882816'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:22.772674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c904440acb4b5ba098cec31bd838e0', 'request_id': 'req-b4b6b0b4-d962-4c79-b047-e4a4ee882816'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:22.785663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] The token cache is being invalidate because project 61c904440acb4b5ba098cec31bd838e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:22.785954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:22.786652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:22.788772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 900/1839] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:22 2022] DELETE /identity/v3/projects/61c904440acb4b5ba098cec31bd838e0 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:22.789718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:22.791122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:22.822909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 940/1840] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:22.824352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3106fa5-051a-4e92-941c-978664ed90e7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:22.825349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d3106fa5-051a-4e92-941c-978664ed90e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:22.856904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6b0b4-d962-4c79-b047-e4a4ee882816 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:22.863790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38bb2c-ba1b-433b-ab03-c6a71e0372a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:22.864553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38bb2c-ba1b-433b-ab03-c6a71e0372a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.864905 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38bb2c-ba1b-433b-ab03-c6a71e0372a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.865259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38bb2c-ba1b-433b-ab03-c6a71e0372a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.868116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1d38bb2c-ba1b-433b-ab03-c6a71e0372a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:22.893149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3106fa5-051a-4e92-941c-978664ed90e7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:22.897322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:22.898785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.898785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.898785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.900853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:22.904328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:22.953406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38bb2c-ba1b-433b-ab03-c6a71e0372a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:22.955429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38bb2c-ba1b-433b-ab03-c6a71e0372a0 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:22.968908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 901/1841] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:22.970563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f08a5e-c646-48f9-9887-07e5cfebcfdb None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:22.970563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f08a5e-c646-48f9-9887-07e5cfebcfdb None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:22.971162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f08a5e-c646-48f9-9887-07e5cfebcfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:22.976165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:22.977518 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:22.999041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a1f08a5e-c646-48f9-9887-07e5cfebcfdb None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:23.000726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a1f08a5e-c646-48f9-9887-07e5cfebcfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:23.002324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 941/1842] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:23.004788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.008319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:23.043633 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bea05d-9b95-4faa-9705-4e3e99942127 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:23.075004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f6964-1c4a-4e7e-8e16-8a19a3506faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:23.075498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f6964-1c4a-4e7e-8e16-8a19a3506faf service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.075778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f6964-1c4a-4e7e-8e16-8a19a3506faf service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.076454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f6964-1c4a-4e7e-8e16-8a19a3506faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.096772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f6964-1c4a-4e7e-8e16-8a19a3506faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:23.098404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f6964-1c4a-4e7e-8e16-8a19a3506faf service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:23.128056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 902/1843] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:23.129154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f08a5e-c646-48f9-9887-07e5cfebcfdb None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.134113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 942/1844] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:23.135249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f6964-1c4a-4e7e-8e16-8a19a3506faf service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.139107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0c0f6964-1c4a-4e7e-8e16-8a19a3506faf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:23.141160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f08a5e-c646-48f9-9887-07e5cfebcfdb None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:23.150030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97430f-4d42-47ba-a147-893ea3b0be9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:23.150608 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97430f-4d42-47ba-a147-893ea3b0be9c service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.150906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97430f-4d42-47ba-a147-893ea3b0be9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.152245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97430f-4d42-47ba-a147-893ea3b0be9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.156417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-fa97430f-4d42-47ba-a147-893ea3b0be9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:23.163859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f6964-1c4a-4e7e-8e16-8a19a3506faf service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:23.169785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:23.170815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.171198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.172556 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] PATH_INFO: `/v3/projects/52e748a288994916958222ddfe25c30e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.174206 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e748a288994916958222ddfe25c30e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:23.176259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:23.191754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:23.280527 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97430f-4d42-47ba-a147-893ea3b0be9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:23.282221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e748a288994916958222ddfe25c30e', 'request_id': 'req-cf59e623-4c28-4e61-8cd8-bba43fe4c689'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:23.282910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97430f-4d42-47ba-a147-893ea3b0be9c service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:23.297129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 903/1845] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:23.298634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5197f-65be-46e8-a43d-c35304d5eda2 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.299115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5197f-65be-46e8-a43d-c35304d5eda2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.299364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5197f-65be-46e8-a43d-c35304d5eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.302233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e748a288994916958222ddfe25c30e', 'request_id': 'req-cf59e623-4c28-4e61-8cd8-bba43fe4c689'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:23.318116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e748a288994916958222ddfe25c30e', 'request_id': 'req-cf59e623-4c28-4e61-8cd8-bba43fe4c689'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:23.326397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-68c5197f-65be-46e8-a43d-c35304d5eda2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:23.327678 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-68c5197f-65be-46e8-a43d-c35304d5eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:23.345865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] The token cache is being invalidate because project 52e748a288994916958222ddfe25c30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:23.346528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:23.348185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cf59e623-4c28-4e61-8cd8-bba43fe4c689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:23.353938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 943/1846] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:23 2022] DELETE /identity/v3/projects/52e748a288994916958222ddfe25c30e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:23.359528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3678850-82b1-4a08-ab29-6b747564e779 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.359880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3678850-82b1-4a08-ab29-6b747564e779 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.360380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3678850-82b1-4a08-ab29-6b747564e779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.396577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c3678850-82b1-4a08-ab29-6b747564e779 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:23.402085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c3678850-82b1-4a08-ab29-6b747564e779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:23.476598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 904/1847] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:23.477867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5197f-65be-46e8-a43d-c35304d5eda2 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.509495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:23.518474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5197f-65be-46e8-a43d-c35304d5eda2 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:23.534102 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 944/1848] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:23.535128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35f8ac-6607-41f1-a9de-4555ed4c9937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:23.536446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35f8ac-6607-41f1-a9de-4555ed4c9937 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.536744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35f8ac-6607-41f1-a9de-4555ed4c9937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.537198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35f8ac-6607-41f1-a9de-4555ed4c9937 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.537962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35f8ac-6607-41f1-a9de-4555ed4c9937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:23.538637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35f8ac-6607-41f1-a9de-4555ed4c9937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:23.540569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35f8ac-6607-41f1-a9de-4555ed4c9937 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:23.541885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28af51-f105-46d6-83e9-73005d430a67 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.542678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28af51-f105-46d6-83e9-73005d430a67 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.543830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28af51-f105-46d6-83e9-73005d430a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.563025 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 905/1849] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:23.570297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35f8ac-6607-41f1-a9de-4555ed4c9937 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.588370 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35f8ac-6607-41f1-a9de-4555ed4c9937 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:23.590250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ab28af51-f105-46d6-83e9-73005d430a67 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:23.591568 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ab28af51-f105-46d6-83e9-73005d430a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:23.596698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1dfa-886f-4920-bd89-5f8532a3d6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:23.597587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1dfa-886f-4920-bd89-5f8532a3d6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.598084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1dfa-886f-4920-bd89-5f8532a3d6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.598973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1dfa-886f-4920-bd89-5f8532a3d6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.599924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1dfa-886f-4920-bd89-5f8532a3d6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:23.603107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 945/1850] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:23.603228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1dfa-886f-4920-bd89-5f8532a3d6a1 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:23.604217 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28af51-f105-46d6-83e9-73005d430a67 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.616021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28af51-f105-46d6-83e9-73005d430a67 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:23.623288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba23d2-69dc-4fd8-9bd0-7fb058734d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:23.629085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba23d2-69dc-4fd8-9bd0-7fb058734d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.629085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba23d2-69dc-4fd8-9bd0-7fb058734d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.629085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba23d2-69dc-4fd8-9bd0-7fb058734d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.629085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba23d2-69dc-4fd8-9bd0-7fb058734d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:23.629085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba23d2-69dc-4fd8-9bd0-7fb058734d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:23.629753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba23d2-69dc-4fd8-9bd0-7fb058734d48 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:23.657781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 906/1851] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:23 2022] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:23.659922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1dfa-886f-4920-bd89-5f8532a3d6a1 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.661233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 946/1852] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:22:23.670681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba23d2-69dc-4fd8-9bd0-7fb058734d48 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.711560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba23d2-69dc-4fd8-9bd0-7fb058734d48 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:23.842945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1dfa-886f-4920-bd89-5f8532a3d6a1 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:23.867849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceaf11-aeb4-4ef2-963b-61595b517131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:23.868827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceaf11-aeb4-4ef2-963b-61595b517131 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.869327 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceaf11-aeb4-4ef2-963b-61595b517131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.869804 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceaf11-aeb4-4ef2-963b-61595b517131 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.871749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceaf11-aeb4-4ef2-963b-61595b517131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:23.876012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ceaf11-aeb4-4ef2-963b-61595b517131 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:23.918105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8eec1-f021-40a0-9a6c-07ccbba9354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:23.920047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8eec1-f021-40a0-9a6c-07ccbba9354d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:23.920337 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8eec1-f021-40a0-9a6c-07ccbba9354d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:23.922015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8eec1-f021-40a0-9a6c-07ccbba9354d admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:23.923702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8eec1-f021-40a0-9a6c-07ccbba9354d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:23.930341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8eec1-f021-40a0-9a6c-07ccbba9354d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:23.943708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 907/1853] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:23 2022] POST /identity/v3/users => generated 303 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:23.945229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceaf11-aeb4-4ef2-963b-61595b517131 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:23.974966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceaf11-aeb4-4ef2-963b-61595b517131 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:24.001972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990d931-bf1c-47e2-b35c-e292ff833a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:24.002745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990d931-bf1c-47e2-b35c-e292ff833a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.005233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990d931-bf1c-47e2-b35c-e292ff833a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.017464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990d931-bf1c-47e2-b35c-e292ff833a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.024312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990d931-bf1c-47e2-b35c-e292ff833a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:24.033063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990d931-bf1c-47e2-b35c-e292ff833a28 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:24.048816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 947/1854] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:23 2022] POST /identity/v3/projects => generated 387 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:24.055726 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8eec1-f021-40a0-9a6c-07ccbba9354d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:24.081826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:24.096534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 908/1855] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:24.104941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990d931-bf1c-47e2-b35c-e292ff833a28 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:24.162218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990d931-bf1c-47e2-b35c-e292ff833a28 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:24.256705 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8eec1-f021-40a0-9a6c-07ccbba9354d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:24.265015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6e48-d29c-43a1-b9a3-fad8af633aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:24.267862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6e48-d29c-43a1-b9a3-fad8af633aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.268469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6e48-d29c-43a1-b9a3-fad8af633aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.268579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6e48-d29c-43a1-b9a3-fad8af633aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.269362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6e48-d29c-43a1-b9a3-fad8af633aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:24.276258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6e48-d29c-43a1-b9a3-fad8af633aa1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:24.306181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 948/1856] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:24 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:24.307681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6e48-d29c-43a1-b9a3-fad8af633aa1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:24.365544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6e48-d29c-43a1-b9a3-fad8af633aa1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:24.395487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3612e-7e99-42c6-802c-4450d3bbb1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:24.396783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3612e-7e99-42c6-802c-4450d3bbb1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.396783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3612e-7e99-42c6-802c-4450d3bbb1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.396783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3612e-7e99-42c6-802c-4450d3bbb1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.397701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3612e-7e99-42c6-802c-4450d3bbb1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:24.400885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3612e-7e99-42c6-802c-4450d3bbb1a2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:24.405868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de31277-6b8e-426a-afa8-de94f4f900db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:24.408358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de31277-6b8e-426a-afa8-de94f4f900db admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.409027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de31277-6b8e-426a-afa8-de94f4f900db admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.409646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de31277-6b8e-426a-afa8-de94f4f900db admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.410815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de31277-6b8e-426a-afa8-de94f4f900db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:24.413646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de31277-6b8e-426a-afa8-de94f4f900db admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:24.429866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 949/1857] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:24.433977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3612e-7e99-42c6-802c-4450d3bbb1a2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:24.437940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 909/1858] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:24.442257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de31277-6b8e-426a-afa8-de94f4f900db admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:24.451042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3612e-7e99-42c6-802c-4450d3bbb1a2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:24.457756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550262c-ac86-4a7e-856e-01fafbfe3e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:24.467410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550262c-ac86-4a7e-856e-01fafbfe3e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.468069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550262c-ac86-4a7e-856e-01fafbfe3e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.468532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550262c-ac86-4a7e-856e-01fafbfe3e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.470266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de31277-6b8e-426a-afa8-de94f4f900db admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:24.471506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550262c-ac86-4a7e-856e-01fafbfe3e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:24.476576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550262c-ac86-4a7e-856e-01fafbfe3e6a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:24.481359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc0b9e-f325-47ca-b490-7cffe501302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:24.482601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc0b9e-f325-47ca-b490-7cffe501302c admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.482830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc0b9e-f325-47ca-b490-7cffe501302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.483110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc0b9e-f325-47ca-b490-7cffe501302c admin admin] PATH_INFO: `/v3/projects/100bebec45f94c43b8856b814a4e8195/users/e88462be30d748209703da88ec037abe/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.499116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 950/1859] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:24.504449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550262c-ac86-4a7e-856e-01fafbfe3e6a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:24.522183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550262c-ac86-4a7e-856e-01fafbfe3e6a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:24.552354 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeabd2-577e-4cb7-b7f6-b599c2b1f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:24.553519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeabd2-577e-4cb7-b7f6-b599c2b1f80b admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.554535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeabd2-577e-4cb7-b7f6-b599c2b1f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.555029 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeabd2-577e-4cb7-b7f6-b599c2b1f80b admin admin] PATH_INFO: `/v3/projects/42baa6e34e79465988a29925cd3da1da/users/b29a81f8ca2343d0a68863046a99bbb5/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.580476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc0b9e-f325-47ca-b490-7cffe501302c admin admin] RBAC: Authorizing `identity:create_grant(project_id=100bebec45f94c43b8856b814a4e8195, user_id=e88462be30d748209703da88ec037abe, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:24.582033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeabd2-577e-4cb7-b7f6-b599c2b1f80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42baa6e34e79465988a29925cd3da1da, user_id=b29a81f8ca2343d0a68863046a99bbb5, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:24.587127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeabd2-577e-4cb7-b7f6-b599c2b1f80b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:24.589284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc0b9e-f325-47ca-b490-7cffe501302c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:24.621702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 951/1860] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:24 2022] PUT /identity/v3/projects/42baa6e34e79465988a29925cd3da1da/users/b29a81f8ca2343d0a68863046a99bbb5/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:24.633147 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148637b9-e95b-49af-ac0b-42e0119be57d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.633840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148637b9-e95b-49af-ac0b-42e0119be57d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.636015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148637b9-e95b-49af-ac0b-42e0119be57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.649036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 910/1861] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:24 2022] PUT /identity/v3/projects/100bebec45f94c43b8856b814a4e8195/users/e88462be30d748209703da88ec037abe/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:24.654891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4320c-33ba-4315-9b78-6e351bcd335a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.655465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4320c-33ba-4315-9b78-6e351bcd335a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.655772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4320c-33ba-4315-9b78-6e351bcd335a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.676660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-148637b9-e95b-49af-ac0b-42e0119be57d None None] MFA Rules not processed for user `b29a81f8ca2343d0a68863046a99bbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:24.678656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-148637b9-e95b-49af-ac0b-42e0119be57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:24.720467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-05b4320c-33ba-4315-9b78-6e351bcd335a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:24.721943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-05b4320c-33ba-4315-9b78-6e351bcd335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:24.768516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:24.786120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 952/1862] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:24.787251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148637b9-e95b-49af-ac0b-42e0119be57d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:24.890113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:24.911947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 911/1863] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:24.942449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4320c-33ba-4315-9b78-6e351bcd335a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:24.944468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-05b4320c-33ba-4315-9b78-6e351bcd335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:24.948223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148637b9-e95b-49af-ac0b-42e0119be57d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:24.962702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60cd8c-dc5e-403e-96dc-87fe1bedad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:24.967261 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60cd8c-dc5e-403e-96dc-87fe1bedad46 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:24.967575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60cd8c-dc5e-403e-96dc-87fe1bedad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:24.967862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60cd8c-dc5e-403e-96dc-87fe1bedad46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:24.968595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60cd8c-dc5e-403e-96dc-87fe1bedad46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:24.970539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60cd8c-dc5e-403e-96dc-87fe1bedad46 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:25.079826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 953/1864] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:24 2022] POST /identity/v3/projects => generated 389 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:25.083799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60cd8c-dc5e-403e-96dc-87fe1bedad46 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:25.141256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4320c-33ba-4315-9b78-6e351bcd335a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:25.291702 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb67729-7179-448f-bbe2-2685b87ca243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:25.294215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb67729-7179-448f-bbe2-2685b87ca243 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:25.296243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60cd8c-dc5e-403e-96dc-87fe1bedad46 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:25.296545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb67729-7179-448f-bbe2-2685b87ca243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:25.297602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb67729-7179-448f-bbe2-2685b87ca243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:25.303286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e723b10-6609-4fee-b450-815eda7049fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:25.304151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723b10-6609-4fee-b450-815eda7049fc admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:25.304546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723b10-6609-4fee-b450-815eda7049fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:25.304930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723b10-6609-4fee-b450-815eda7049fc admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:25.306000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e723b10-6609-4fee-b450-815eda7049fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:25.308563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e723b10-6609-4fee-b450-815eda7049fc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:25.322664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb67729-7179-448f-bbe2-2685b87ca243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:25.326918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb67729-7179-448f-bbe2-2685b87ca243 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:25.340472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 954/1865] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:25 2022] POST /identity/v3/users => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:25.344838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e723b10-6609-4fee-b450-815eda7049fc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:25.351804 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 912/1866] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:25.371357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e723b10-6609-4fee-b450-815eda7049fc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:25.388823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e508445-744d-4198-a52d-9b6083199a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:25.389669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e508445-744d-4198-a52d-9b6083199a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:25.389964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e508445-744d-4198-a52d-9b6083199a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:25.390297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e508445-744d-4198-a52d-9b6083199a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:25.391047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e508445-744d-4198-a52d-9b6083199a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:25.396010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e508445-744d-4198-a52d-9b6083199a13 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:25.452445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 955/1867] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:25.457397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb67729-7179-448f-bbe2-2685b87ca243 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:25.473601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb67729-7179-448f-bbe2-2685b87ca243 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:25.486461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee7a6d-6d10-4a64-8892-5ced4f41c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:25.488877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee7a6d-6d10-4a64-8892-5ced4f41c479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:25.492871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee7a6d-6d10-4a64-8892-5ced4f41c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:25.492871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee7a6d-6d10-4a64-8892-5ced4f41c479 admin admin] PATH_INFO: `/v3/projects/83fcde8b79304869bd4d0135a7ef1a89/users/8f52c93ed33c4ab4aa039682cbef8e34/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:25.518094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee7a6d-6d10-4a64-8892-5ced4f41c479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fcde8b79304869bd4d0135a7ef1a89, user_id=8f52c93ed33c4ab4aa039682cbef8e34, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:25.521700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee7a6d-6d10-4a64-8892-5ced4f41c479 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:25.543659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 913/1868] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:25 2022] PUT /identity/v3/projects/83fcde8b79304869bd4d0135a7ef1a89/users/8f52c93ed33c4ab4aa039682cbef8e34/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:25.547631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e508445-744d-4198-a52d-9b6083199a13 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:25.562327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e508445-744d-4198-a52d-9b6083199a13 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:25.704963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242ad66-7345-40f4-93ff-3e4a1e6560df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:25.705922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242ad66-7345-40f4-93ff-3e4a1e6560df admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:25.706410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242ad66-7345-40f4-93ff-3e4a1e6560df admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:25.706864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242ad66-7345-40f4-93ff-3e4a1e6560df admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:25.707690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242ad66-7345-40f4-93ff-3e4a1e6560df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:25.709544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242ad66-7345-40f4-93ff-3e4a1e6560df admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:25.723987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 956/1869] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:25.728954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee7a6d-6d10-4a64-8892-5ced4f41c479 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:25.746276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee7a6d-6d10-4a64-8892-5ced4f41c479 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:25.751471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242ad66-7345-40f4-93ff-3e4a1e6560df admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:25.751660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb7dc4-2772-4ea6-8bed-ead6fd7b3404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:25.753340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7dc4-2772-4ea6-8bed-ead6fd7b3404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:25.753826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f242ad66-7345-40f4-93ff-3e4a1e6560df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:25.754093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7dc4-2772-4ea6-8bed-ead6fd7b3404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:25.754378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb7dc4-2772-4ea6-8bed-ead6fd7b3404 admin admin] PATH_INFO: `/v3/projects/83fcde8b79304869bd4d0135a7ef1a89/users/8f52c93ed33c4ab4aa039682cbef8e34/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:25.757204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb7dc4-2772-4ea6-8bed-ead6fd7b3404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fcde8b79304869bd4d0135a7ef1a89, user_id=8f52c93ed33c4ab4aa039682cbef8e34, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:25.761033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb7dc4-2772-4ea6-8bed-ead6fd7b3404 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:25.773094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242ad66-7345-40f4-93ff-3e4a1e6560df admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:25.773808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 914/1870] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:25 2022] PUT /identity/v3/projects/83fcde8b79304869bd4d0135a7ef1a89/users/8f52c93ed33c4ab4aa039682cbef8e34/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:25.784976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef4e93-3694-4691-a69f-a501acc70ff1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:25.785343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef4e93-3694-4691-a69f-a501acc70ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:25.785963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef4e93-3694-4691-a69f-a501acc70ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:25.834205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:25.835544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-11ef4e93-3694-4691-a69f-a501acc70ff1 None None] MFA Rules not processed for user `8f52c93ed33c4ab4aa039682cbef8e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:25.841532 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-11ef4e93-3694-4691-a69f-a501acc70ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:25.861975 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:25.863112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:25.863693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:25.864253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] PATH_INFO: `/v3/users/7d68536f19544195a9a593a48c9a9e1e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:25.865990 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d68536f19544195a9a593a48c9a9e1e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:25.868602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:25.922211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:26.005149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d68536f19544195a9a593a48c9a9e1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:26.023408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d68536f19544195a9a593a48c9a9e1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:26.024639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d68536f19544195a9a593a48c9a9e1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:26.046987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d68536f19544195a9a593a48c9a9e1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:26.062877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 915/1871] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:26.075728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-33ed212c-392f-4d41-b776-36f6ddb8f3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d68536f19544195a9a593a48c9a9e1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:26.077494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef4e93-3694-4691-a69f-a501acc70ff1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:26.080364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-11ef4e93-3694-4691-a69f-a501acc70ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:26.098561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 957/1872] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:25 2022] DELETE /identity/v3/users/7d68536f19544195a9a593a48c9a9e1e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:26.104424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765f5da-6f6c-454f-8cd4-1075b9ffb133 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:26.104789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765f5da-6f6c-454f-8cd4-1075b9ffb133 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:26.105409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765f5da-6f6c-454f-8cd4-1075b9ffb133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:26.128918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7765f5da-6f6c-454f-8cd4-1075b9ffb133 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:26.130240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7765f5da-6f6c-454f-8cd4-1075b9ffb133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:26.270516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef4e93-3694-4691-a69f-a501acc70ff1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:26.355450 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 958/1873] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:26.419325 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:26.424818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:26.425134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:26.425392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:26.429176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:26.436422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765f5da-6f6c-454f-8cd4-1075b9ffb133 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:26.438141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7765f5da-6f6c-454f-8cd4-1075b9ffb133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:26.608595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:26.611197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:26.623387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765f5da-6f6c-454f-8cd4-1075b9ffb133 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:26.624254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 916/1874] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:22:26.644560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ca373-0384-4fbe-82c7-22ee5657d4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:26.644904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca373-0384-4fbe-82c7-22ee5657d4ee service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:26.645301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca373-0384-4fbe-82c7-22ee5657d4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:26.645579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca373-0384-4fbe-82c7-22ee5657d4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:26.672506 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ca373-0384-4fbe-82c7-22ee5657d4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:26.674334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ca373-0384-4fbe-82c7-22ee5657d4ee service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:26.699858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 959/1875] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:26.902312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:26.904469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:26.942043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17d18-8fbf-42a4-90bb-99a99d5643c0 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:26.958521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:26.959270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:26.959599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:26.959878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] PATH_INFO: `/v3/users/b29a81f8ca2343d0a68863046a99bbb5` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:26.962767 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29a81f8ca2343d0a68863046a99bbb5)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:26.967313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.018042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cb89b-e7a2-4c46-9bd6-3e973e37b42a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.018355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cb89b-e7a2-4c46-9bd6-3e973e37b42a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.018646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cb89b-e7a2-4c46-9bd6-3e973e37b42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.026568 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:27.046177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:27.090750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29a81f8ca2343d0a68863046a99bbb5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:27.091969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29a81f8ca2343d0a68863046a99bbb5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:27.099552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-024cb89b-e7a2-4c46-9bd6-3e973e37b42a None None] MFA Rules not processed for user `e88462be30d748209703da88ec037abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:27.102419 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-024cb89b-e7a2-4c46-9bd6-3e973e37b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:27.103361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29a81f8ca2343d0a68863046a99bbb5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:27.104918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29a81f8ca2343d0a68863046a99bbb5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:27.127942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-21a77c62-d6d5-4aa1-affc-b5a183a20a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29a81f8ca2343d0a68863046a99bbb5'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:27.181151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 917/1876] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:26 2022] DELETE /identity/v3/users/b29a81f8ca2343d0a68863046a99bbb5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:27.182676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d181db-ccb6-45c0-b77b-24d9d145052d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.182970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d181db-ccb6-45c0-b77b-24d9d145052d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.183245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d181db-ccb6-45c0-b77b-24d9d145052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.236743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 960/1877] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:27.237567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cb89b-e7a2-4c46-9bd6-3e973e37b42a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:27.239865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-024cb89b-e7a2-4c46-9bd6-3e973e37b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:27.247471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-31d181db-ccb6-45c0-b77b-24d9d145052d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:27.248727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-31d181db-ccb6-45c0-b77b-24d9d145052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:27.261669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024cb89b-e7a2-4c46-9bd6-3e973e37b42a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:27.356035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1754c8-bfcc-4a41-bc6a-bd8469a03d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:27.356829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1754c8-bfcc-4a41-bc6a-bd8469a03d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.357159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1754c8-bfcc-4a41-bc6a-bd8469a03d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.357503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1754c8-bfcc-4a41-bc6a-bd8469a03d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.358649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1754c8-bfcc-4a41-bc6a-bd8469a03d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:27.361668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1754c8-bfcc-4a41-bc6a-bd8469a03d78 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.405767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 961/1878] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:27 2022] POST /identity/v3/projects => generated 401 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:27.410154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1754c8-bfcc-4a41-bc6a-bd8469a03d78 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:27.469422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 918/1879] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:27.517069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d181db-ccb6-45c0-b77b-24d9d145052d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:27.521976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-31d181db-ccb6-45c0-b77b-24d9d145052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:27.606887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1754c8-bfcc-4a41-bc6a-bd8469a03d78 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:27.625232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dba9c-1a17-4803-a608-8aba7632daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:27.626575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dba9c-1a17-4803-a608-8aba7632daa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.627013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dba9c-1a17-4803-a608-8aba7632daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.627502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dba9c-1a17-4803-a608-8aba7632daa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.628545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dba9c-1a17-4803-a608-8aba7632daa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:27.630636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dba9c-1a17-4803-a608-8aba7632daa7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.667538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d181db-ccb6-45c0-b77b-24d9d145052d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:27.687395 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 962/1880] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:27 2022] POST /identity/v3/users => generated 307 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:27.688500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dba9c-1a17-4803-a608-8aba7632daa7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:27.704022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dba9c-1a17-4803-a608-8aba7632daa7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:27.720135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c0928-d924-402e-9751-e1b55372d5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:27.720849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0928-d924-402e-9751-e1b55372d5cd admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.721136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0928-d924-402e-9751-e1b55372d5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.721487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c0928-d924-402e-9751-e1b55372d5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.722230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c0928-d924-402e-9751-e1b55372d5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:27.726018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c0928-d924-402e-9751-e1b55372d5cd admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.727797 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:27.752693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 963/1881] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:27.754320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c0928-d924-402e-9751-e1b55372d5cd admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:27.766866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c0928-d924-402e-9751-e1b55372d5cd admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:27.773223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7a731-28b0-456f-afe5-4396b2ecbd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:27.774285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7a731-28b0-456f-afe5-4396b2ecbd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.774712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7a731-28b0-456f-afe5-4396b2ecbd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.775199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7a731-28b0-456f-afe5-4396b2ecbd9c admin admin] PATH_INFO: `/v3/projects/399545ed101e4e998d6c77041480ab91/users/38c75656a29847b68a11d672f7197bf9/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.800566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaa630-0d40-423c-b805-e3b5dceb3db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:27.801400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaa630-0d40-423c-b805-e3b5dceb3db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.801689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaa630-0d40-423c-b805-e3b5dceb3db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.802128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaa630-0d40-423c-b805-e3b5dceb3db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.811249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7a731-28b0-456f-afe5-4396b2ecbd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=399545ed101e4e998d6c77041480ab91, user_id=38c75656a29847b68a11d672f7197bf9, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:27.816614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7a731-28b0-456f-afe5-4396b2ecbd9c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.825036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaa630-0d40-423c-b805-e3b5dceb3db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:27.826365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaa630-0d40-423c-b805-e3b5dceb3db7 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.843128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 964/1882] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:27 2022] PUT /identity/v3/projects/399545ed101e4e998d6c77041480ab91/users/38c75656a29847b68a11d672f7197bf9/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:27.844182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7a731-28b0-456f-afe5-4396b2ecbd9c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:27.856717 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 919/1883] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:27.954979 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7a731-28b0-456f-afe5-4396b2ecbd9c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:27.959847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f286216-f62f-4b9e-978d-1cca616b6c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:27.960525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f286216-f62f-4b9e-978d-1cca616b6c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:27.960811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f286216-f62f-4b9e-978d-1cca616b6c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:27.961092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f286216-f62f-4b9e-978d-1cca616b6c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:27.961970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f286216-f62f-4b9e-978d-1cca616b6c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:27.964150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f286216-f62f-4b9e-978d-1cca616b6c88 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:27.975438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 965/1884] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:27.979849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaa630-0d40-423c-b805-e3b5dceb3db7 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:27.996654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:28.022982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaa630-0d40-423c-b805-e3b5dceb3db7 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:28.039757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81331e8f-c060-4bb1-a031-b213ce432247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:28.041251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81331e8f-c060-4bb1-a031-b213ce432247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:28.042730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81331e8f-c060-4bb1-a031-b213ce432247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:28.043326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81331e8f-c060-4bb1-a031-b213ce432247 admin admin] PATH_INFO: `/v3/projects/399545ed101e4e998d6c77041480ab91/users/38c75656a29847b68a11d672f7197bf9/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:28.047809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81331e8f-c060-4bb1-a031-b213ce432247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399545ed101e4e998d6c77041480ab91, user_id=38c75656a29847b68a11d672f7197bf9, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:28.053393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81331e8f-c060-4bb1-a031-b213ce432247 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:28.070525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 920/1885] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:27 2022] PUT /identity/v3/projects/399545ed101e4e998d6c77041480ab91/users/38c75656a29847b68a11d672f7197bf9/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:28.213688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f286216-f62f-4b9e-978d-1cca616b6c88 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:28.215607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4f286216-f62f-4b9e-978d-1cca616b6c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:28.231773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f286216-f62f-4b9e-978d-1cca616b6c88 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:28.359877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:28.361646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:28.362207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:28.362685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] PATH_INFO: `/v3/projects/c374a62f8ddf46a9976b40c7f1bac4fc` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:28.364127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c374a62f8ddf46a9976b40c7f1bac4fc)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:28.366741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:28.455314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c374a62f8ddf46a9976b40c7f1bac4fc', 'request_id': 'req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.468918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c374a62f8ddf46a9976b40c7f1bac4fc', 'request_id': 'req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.484359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c374a62f8ddf46a9976b40c7f1bac4fc', 'request_id': 'req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.504905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:28.518202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] The token cache is being invalidate because project c374a62f8ddf46a9976b40c7f1bac4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:28.519028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.522084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.527208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 966/1886] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:28 2022] DELETE /identity/v3/projects/c374a62f8ddf46a9976b40c7f1bac4fc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:28.529399 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81331e8f-c060-4bb1-a031-b213ce432247 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:28.531563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-81331e8f-c060-4bb1-a031-b213ce432247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:28.555439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81331e8f-c060-4bb1-a031-b213ce432247 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:28.641336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:28.642240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:28.642664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:28.642949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] PATH_INFO: `/v3/users/270cca5fa44a437e91ef3749f782f9e9` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:28.644260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=270cca5fa44a437e91ef3749f782f9e9)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:28.646191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:28.701473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270cca5fa44a437e91ef3749f782f9e9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.702439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270cca5fa44a437e91ef3749f782f9e9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.710620 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270cca5fa44a437e91ef3749f782f9e9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.711147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270cca5fa44a437e91ef3749f782f9e9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.719809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270cca5fa44a437e91ef3749f782f9e9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:28.743992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 921/1887] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:28 2022] DELETE /identity/v3/users/270cca5fa44a437e91ef3749f782f9e9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:29.054438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:29.056530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:29.078668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ad07c-0435-49f8-ba3a-b8cbc4ef5c5f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:29.223142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:29.224081 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:29.224942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:29.225229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] PATH_INFO: `/v3/projects/42baa6e34e79465988a29925cd3da1da` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:29.226660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42baa6e34e79465988a29925cd3da1da)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:29.229075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:29.284481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:29.286661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:29.300112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42baa6e34e79465988a29925cd3da1da', 'request_id': 'req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.320400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42baa6e34e79465988a29925cd3da1da', 'request_id': 'req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.322114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bba06-3d3d-41b5-afff-d7cccea15080 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:29.329940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42baa6e34e79465988a29925cd3da1da', 'request_id': 'req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.350179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] The token cache is being invalidate because project 42baa6e34e79465988a29925cd3da1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:29.350843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.360843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.368557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 967/1888] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:29 2022] DELETE /identity/v3/projects/42baa6e34e79465988a29925cd3da1da => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:29.371365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:29.373245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:29.454152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:29.455411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:29.455891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:29.456538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] PATH_INFO: `/v3/projects/5226022863d14a78ae19b74bde021e50` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:29.460933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5226022863d14a78ae19b74bde021e50)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:29.464966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:29.471328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c61b7-5632-4f8e-93b4-ae6660fdb90c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:29.482550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:29.484041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:29.484517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:29.485166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] PATH_INFO: `/v3/users/8f52c93ed33c4ab4aa039682cbef8e34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:29.486641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f52c93ed33c4ab4aa039682cbef8e34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:29.489046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:29.534304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:29.606210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:29.636143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f52c93ed33c4ab4aa039682cbef8e34'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.640055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5226022863d14a78ae19b74bde021e50', 'request_id': 'req-7354b714-d768-48c4-b791-94a030a98b59'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.647317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f52c93ed33c4ab4aa039682cbef8e34'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.648337 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f52c93ed33c4ab4aa039682cbef8e34'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.656164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5226022863d14a78ae19b74bde021e50', 'request_id': 'req-7354b714-d768-48c4-b791-94a030a98b59'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.659849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f52c93ed33c4ab4aa039682cbef8e34'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.683372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ca58793f-e5bd-4f18-a43a-fe7a53d7c4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f52c93ed33c4ab4aa039682cbef8e34'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.684761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5226022863d14a78ae19b74bde021e50', 'request_id': 'req-7354b714-d768-48c4-b791-94a030a98b59'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.699503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 968/1889] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:29 2022] DELETE /identity/v3/users/8f52c93ed33c4ab4aa039682cbef8e34 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:29.717178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] The token cache is being invalidate because project 5226022863d14a78ae19b74bde021e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:29.717617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.720368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:29.726467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 922/1890] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:29 2022] DELETE /identity/v3/projects/5226022863d14a78ae19b74bde021e50 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:29.731084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5e5c4-a340-49ed-8b54-7144b7294e34 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:29.731427 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5e5c4-a340-49ed-8b54-7144b7294e34 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:29.731716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5e5c4-a340-49ed-8b54-7144b7294e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:29.784105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-abc5e5c4-a340-49ed-8b54-7144b7294e34 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:29.785366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-abc5e5c4-a340-49ed-8b54-7144b7294e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:29.874639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:29.876130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:29.932076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 969/1891] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:29.942751 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1942952-201a-492b-b3f0-bf43cf4fc301 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:29.943087 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1942952-201a-492b-b3f0-bf43cf4fc301 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:29.943349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1942952-201a-492b-b3f0-bf43cf4fc301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:29.971441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354b714-d768-48c4-b791-94a030a98b59 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:29.978456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:29.980193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:29.980552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:29.980958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] PATH_INFO: `/v3/users/1697892c0d9e43718c4cd15017eeb48f` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:29.982366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1697892c0d9e43718c4cd15017eeb48f)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:29.985889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.005289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e1942952-201a-492b-b3f0-bf43cf4fc301 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:30.007166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e1942952-201a-492b-b3f0-bf43cf4fc301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:30.035476 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 970/1892] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:30.037404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1942952-201a-492b-b3f0-bf43cf4fc301 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.049694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1942952-201a-492b-b3f0-bf43cf4fc301 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.055943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849ce1f-00ea-4b25-a18b-6091ad4dcbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.058051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849ce1f-00ea-4b25-a18b-6091ad4dcbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.058051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849ce1f-00ea-4b25-a18b-6091ad4dcbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.058051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849ce1f-00ea-4b25-a18b-6091ad4dcbe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.059649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849ce1f-00ea-4b25-a18b-6091ad4dcbe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:30.060396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849ce1f-00ea-4b25-a18b-6091ad4dcbe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.062632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849ce1f-00ea-4b25-a18b-6091ad4dcbe6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.080483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1697892c0d9e43718c4cd15017eeb48f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:30.081713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 971/1893] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:30.082046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1697892c0d9e43718c4cd15017eeb48f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:30.087047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849ce1f-00ea-4b25-a18b-6091ad4dcbe6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.093598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1697892c0d9e43718c4cd15017eeb48f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:30.094503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1697892c0d9e43718c4cd15017eeb48f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:30.101425 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849ce1f-00ea-4b25-a18b-6091ad4dcbe6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.107199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d6c6666d-2143-4170-9f5b-776668dbe9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1697892c0d9e43718c4cd15017eeb48f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:30.114141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5723-2b2d-44b8-86f5-b7210662c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.114965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5723-2b2d-44b8-86f5-b7210662c1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.115364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5723-2b2d-44b8-86f5-b7210662c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.115765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5723-2b2d-44b8-86f5-b7210662c1a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.116566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a5723-2b2d-44b8-86f5-b7210662c1a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.119914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a5723-2b2d-44b8-86f5-b7210662c1a3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.135385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 923/1894] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:29 2022] DELETE /identity/v3/users/1697892c0d9e43718c4cd15017eeb48f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:30.140975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c764b-2a6d-42a6-ad8a-fedfda25f4d4 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.141273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c764b-2a6d-42a6-ad8a-fedfda25f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.141554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c764b-2a6d-42a6-ad8a-fedfda25f4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.169195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-924c764b-2a6d-42a6-ad8a-fedfda25f4d4 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:30.170643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-924c764b-2a6d-42a6-ad8a-fedfda25f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:30.178691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 972/1895] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:30 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:30.180142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5723-2b2d-44b8-86f5-b7210662c1a3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.182177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-843a5723-2b2d-44b8-86f5-b7210662c1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:30.192836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:30.268960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 924/1896] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:30.292599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5723-2b2d-44b8-86f5-b7210662c1a3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.295189 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c764b-2a6d-42a6-ad8a-fedfda25f4d4 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.301350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-924c764b-2a6d-42a6-ad8a-fedfda25f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:30.304257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5ac6-e3fe-46cd-91ee-5c529c7fe55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.305444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5ac6-e3fe-46cd-91ee-5c529c7fe55d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.305925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5ac6-e3fe-46cd-91ee-5c529c7fe55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.306397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c5ac6-e3fe-46cd-91ee-5c529c7fe55d admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.308967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c5ac6-e3fe-46cd-91ee-5c529c7fe55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.312011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c5ac6-e3fe-46cd-91ee-5c529c7fe55d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.328453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:30.354813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 973/1897] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:30 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:30.356420 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5ac6-e3fe-46cd-91ee-5c529c7fe55d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.368981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c5ac6-e3fe-46cd-91ee-5c529c7fe55d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.375455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07301b6-6b12-468b-9d73-239c23f0af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.376579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07301b6-6b12-468b-9d73-239c23f0af7d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.377010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07301b6-6b12-468b-9d73-239c23f0af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.377496 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07301b6-6b12-468b-9d73-239c23f0af7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.378556 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07301b6-6b12-468b-9d73-239c23f0af7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.380747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07301b6-6b12-468b-9d73-239c23f0af7d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.400053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 974/1898] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:30.410767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07301b6-6b12-468b-9d73-239c23f0af7d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.421325 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c764b-2a6d-42a6-ad8a-fedfda25f4d4 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.423653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07301b6-6b12-468b-9d73-239c23f0af7d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.429710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b57f1a-95ef-403e-ba8c-d15790b9a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.430778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b57f1a-95ef-403e-ba8c-d15790b9a6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.431674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b57f1a-95ef-403e-ba8c-d15790b9a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.432139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b57f1a-95ef-403e-ba8c-d15790b9a6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.433140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b57f1a-95ef-403e-ba8c-d15790b9a6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.434873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b57f1a-95ef-403e-ba8c-d15790b9a6c7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.457798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 975/1899] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:30.459612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b57f1a-95ef-403e-ba8c-d15790b9a6c7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.497992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b57f1a-95ef-403e-ba8c-d15790b9a6c7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:30.509000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5a212-7479-44fa-9ca0-f118284aed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.511148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5a212-7479-44fa-9ca0-f118284aed24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.512187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5a212-7479-44fa-9ca0-f118284aed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.512859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5a212-7479-44fa-9ca0-f118284aed24 admin admin] PATH_INFO: `/v3/projects/20f158307324417e993598494e210bb9/users/7c9278a968834981a11b84dddbf4b3fa/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.516959 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4b729-a5fb-432e-87e5-98ef99cb54a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:30.517673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4b729-a5fb-432e-87e5-98ef99cb54a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.518016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4b729-a5fb-432e-87e5-98ef99cb54a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.518302 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4b729-a5fb-432e-87e5-98ef99cb54a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.531162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4b729-a5fb-432e-87e5-98ef99cb54a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.532665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4b729-a5fb-432e-87e5-98ef99cb54a3 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.533867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5a212-7479-44fa-9ca0-f118284aed24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f158307324417e993598494e210bb9, user_id=7c9278a968834981a11b84dddbf4b3fa, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:30.536948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5a212-7479-44fa-9ca0-f118284aed24 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:30.546080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 925/1900] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:22:30.547778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacaf96-ca08-415f-9503-f4e54336910e None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.548090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacaf96-ca08-415f-9503-f4e54336910e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.548379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacaf96-ca08-415f-9503-f4e54336910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.568565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 976/1901] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:30 2022] PUT /identity/v3/projects/20f158307324417e993598494e210bb9/users/7c9278a968834981a11b84dddbf4b3fa/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:30.572039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea488356-b690-4dd6-b1d3-aa0764209b05 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:30.572339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea488356-b690-4dd6-b1d3-aa0764209b05 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:30.573370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea488356-b690-4dd6-b1d3-aa0764209b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:30.593598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6cacaf96-ca08-415f-9503-f4e54336910e None None] MFA Rules not processed for user `38c75656a29847b68a11d672f7197bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:30.595290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6cacaf96-ca08-415f-9503-f4e54336910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:30.660832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ea488356-b690-4dd6-b1d3-aa0764209b05 None None] MFA Rules not processed for user `7c9278a968834981a11b84dddbf4b3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:30.662108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ea488356-b690-4dd6-b1d3-aa0764209b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:30.727772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 926/1902] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:30.852477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacaf96-ca08-415f-9503-f4e54336910e None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.854338 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6cacaf96-ca08-415f-9503-f4e54336910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:30.867798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 977/1903] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:30.868809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea488356-b690-4dd6-b1d3-aa0764209b05 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:30.873876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:31.002955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea488356-b690-4dd6-b1d3-aa0764209b05 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.013535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacaf96-ca08-415f-9503-f4e54336910e None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.015895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f8f04-4821-4dd0-bbe4-85f2fb61ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.016604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f8f04-4821-4dd0-bbe4-85f2fb61ab56 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.016898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f8f04-4821-4dd0-bbe4-85f2fb61ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.017172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f8f04-4821-4dd0-bbe4-85f2fb61ab56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.017883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f8f04-4821-4dd0-bbe4-85f2fb61ab56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.019863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f8f04-4821-4dd0-bbe4-85f2fb61ab56 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.023676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.024809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.025335 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.025933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] PATH_INFO: `/v3/projects/83fcde8b79304869bd4d0135a7ef1a89` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.027789 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=83fcde8b79304869bd4d0135a7ef1a89)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.030647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.059073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 978/1904] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:30 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:31.063786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f8f04-4821-4dd0-bbe4-85f2fb61ab56 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.105596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:31.155256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83fcde8b79304869bd4d0135a7ef1a89', 'request_id': 'req-56097c77-67b8-406b-8b89-669da1e9d08f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:31.176776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83fcde8b79304869bd4d0135a7ef1a89', 'request_id': 'req-56097c77-67b8-406b-8b89-669da1e9d08f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:31.199729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83fcde8b79304869bd4d0135a7ef1a89', 'request_id': 'req-56097c77-67b8-406b-8b89-669da1e9d08f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:31.210625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f8f04-4821-4dd0-bbe4-85f2fb61ab56 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.219204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] The token cache is being invalidate because project 83fcde8b79304869bd4d0135a7ef1a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:31.219552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:31.221278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-56097c77-67b8-406b-8b89-669da1e9d08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:31.224467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 927/1905] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:30 2022] DELETE /identity/v3/projects/83fcde8b79304869bd4d0135a7ef1a89 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:31.231590 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b5f6-e0cd-4b13-9923-dd5967515a74 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.231888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b5f6-e0cd-4b13-9923-dd5967515a74 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.232171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b5f6-e0cd-4b13-9923-dd5967515a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.253345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-94e4b5f6-e0cd-4b13-9923-dd5967515a74 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:31.255471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-94e4b5f6-e0cd-4b13-9923-dd5967515a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:31.382105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c385-8a1f-4447-9347-e4bd2c4ed72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.382850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c385-8a1f-4447-9347-e4bd2c4ed72c admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.383126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c385-8a1f-4447-9347-e4bd2c4ed72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.383435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16c385-8a1f-4447-9347-e4bd2c4ed72c admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.387580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16c385-8a1f-4447-9347-e4bd2c4ed72c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.399948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 928/1906] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:31.400493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16c385-8a1f-4447-9347-e4bd2c4ed72c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.402289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46380553-6431-456f-80c2-d87d3d8750b4 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.402738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46380553-6431-456f-80c2-d87d3d8750b4 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.403231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46380553-6431-456f-80c2-d87d3d8750b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.435626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-46380553-6431-456f-80c2-d87d3d8750b4 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:31.437660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-46380553-6431-456f-80c2-d87d3d8750b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:31.442460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 979/1907] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:31 2022] POST /identity/v3/users => generated 290 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:31.446399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c385-8a1f-4447-9347-e4bd2c4ed72c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.450161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 929/1908] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:31.451181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ca16c385-8a1f-4447-9347-e4bd2c4ed72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:31.454353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46380553-6431-456f-80c2-d87d3d8750b4 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.466700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46380553-6431-456f-80c2-d87d3d8750b4 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.474432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84e02b-a888-4e4d-a851-b2ae18a6ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.476326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84e02b-a888-4e4d-a851-b2ae18a6ad85 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.476615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84e02b-a888-4e4d-a851-b2ae18a6ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.476897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84e02b-a888-4e4d-a851-b2ae18a6ad85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.477512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16c385-8a1f-4447-9347-e4bd2c4ed72c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.478957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84e02b-a888-4e4d-a851-b2ae18a6ad85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:31.486300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84e02b-a888-4e4d-a851-b2ae18a6ad85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.488222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84e02b-a888-4e4d-a851-b2ae18a6ad85 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.494539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffde89-9bf3-4683-b177-090c01f1d9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.495326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffde89-9bf3-4683-b177-090c01f1d9ce admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.495701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffde89-9bf3-4683-b177-090c01f1d9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.496047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffde89-9bf3-4683-b177-090c01f1d9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.496854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffde89-9bf3-4683-b177-090c01f1d9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.499959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffde89-9bf3-4683-b177-090c01f1d9ce admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.520181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 930/1909] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:31.527244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 980/1910] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:31.528529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84e02b-a888-4e4d-a851-b2ae18a6ad85 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.539525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffde89-9bf3-4683-b177-090c01f1d9ce admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.550791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffde89-9bf3-4683-b177-090c01f1d9ce admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.558021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84e02b-a888-4e4d-a851-b2ae18a6ad85 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.564994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85dcfb-1916-4c8d-b944-977c7666f6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.565588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2126-a40b-4e63-ab8a-8fddcd48d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.565711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85dcfb-1916-4c8d-b944-977c7666f6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.565874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85dcfb-1916-4c8d-b944-977c7666f6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.566155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85dcfb-1916-4c8d-b944-977c7666f6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.566912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85dcfb-1916-4c8d-b944-977c7666f6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.567404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2126-a40b-4e63-ab8a-8fddcd48d6af admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.567870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2126-a40b-4e63-ab8a-8fddcd48d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.568325 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2126-a40b-4e63-ab8a-8fddcd48d6af admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.568520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85dcfb-1916-4c8d-b944-977c7666f6a1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.569397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d2126-a40b-4e63-ab8a-8fddcd48d6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.572041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d2126-a40b-4e63-ab8a-8fddcd48d6af admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.591480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 981/1911] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:31.592447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85dcfb-1916-4c8d-b944-977c7666f6a1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.594514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:31.605247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85dcfb-1916-4c8d-b944-977c7666f6a1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.611925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274affa5-8750-4aee-9da8-9b2887f583e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.612822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274affa5-8750-4aee-9da8-9b2887f583e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.613110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274affa5-8750-4aee-9da8-9b2887f583e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.613393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274affa5-8750-4aee-9da8-9b2887f583e5 admin admin] PATH_INFO: `/v3/projects/a3658bac4afb4a6d866a335756d44b06/users/258424bf2ed6437095116d10b0c2b088/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.615946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 931/1912] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:31 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:31.620067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2126-a40b-4e63-ab8a-8fddcd48d6af admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.632516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274affa5-8750-4aee-9da8-9b2887f583e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3658bac4afb4a6d866a335756d44b06, user_id=258424bf2ed6437095116d10b0c2b088, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.643490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274affa5-8750-4aee-9da8-9b2887f583e5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.661900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 982/1913] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:31 2022] PUT /identity/v3/projects/a3658bac4afb4a6d866a335756d44b06/users/258424bf2ed6437095116d10b0c2b088/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:31.674380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc2b1-bcbc-44ef-a627-6ce227164e37 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.674666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc2b1-bcbc-44ef-a627-6ce227164e37 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.674946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc2b1-bcbc-44ef-a627-6ce227164e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.705538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2126-a40b-4e63-ab8a-8fddcd48d6af admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.722126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-32ebc2b1-bcbc-44ef-a627-6ce227164e37 None None] MFA Rules not processed for user `258424bf2ed6437095116d10b0c2b088`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:31.724284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-32ebc2b1-bcbc-44ef-a627-6ce227164e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:31.783875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6442b9-e1b5-440f-bab5-d2f5b39ea825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.784797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6442b9-e1b5-440f-bab5-d2f5b39ea825 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.785092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6442b9-e1b5-440f-bab5-d2f5b39ea825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.785374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6442b9-e1b5-440f-bab5-d2f5b39ea825 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.786142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6442b9-e1b5-440f-bab5-d2f5b39ea825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.789014 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6442b9-e1b5-440f-bab5-d2f5b39ea825 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.817081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 932/1914] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:31 2022] POST /identity/v3/users => generated 305 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:31.817650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 983/1915] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:31.821064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebc2b1-bcbc-44ef-a627-6ce227164e37 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.824678 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6442b9-e1b5-440f-bab5-d2f5b39ea825 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.837858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6442b9-e1b5-440f-bab5-d2f5b39ea825 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.843611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d9a4d-932e-4793-a32b-d5faa187f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.844555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9a4d-932e-4793-a32b-d5faa187f646 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.846126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9a4d-932e-4793-a32b-d5faa187f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.846126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d9a4d-932e-4793-a32b-d5faa187f646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.850848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:31.862897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d9a4d-932e-4793-a32b-d5faa187f646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.863170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebc2b1-bcbc-44ef-a627-6ce227164e37 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:31.866404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d9a4d-932e-4793-a32b-d5faa187f646 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.876125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82210e51-2c49-4401-9036-d5532083e953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:31.876912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210e51-2c49-4401-9036-d5532083e953 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:31.877199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210e51-2c49-4401-9036-d5532083e953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:31.877473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82210e51-2c49-4401-9036-d5532083e953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:31.878542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82210e51-2c49-4401-9036-d5532083e953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:31.882917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82210e51-2c49-4401-9036-d5532083e953 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:31.900552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 984/1916] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:31.905963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82210e51-2c49-4401-9036-d5532083e953 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.923197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 933/1917] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:31 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:31.927368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d9a4d-932e-4793-a32b-d5faa187f646 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:31.928937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82210e51-2c49-4401-9036-d5532083e953 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.038781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d9a4d-932e-4793-a32b-d5faa187f646 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.048675 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0054a-0a2b-4b5f-b027-84c33b13d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.049660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0054a-0a2b-4b5f-b027-84c33b13d9bd admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.050133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0054a-0a2b-4b5f-b027-84c33b13d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.050807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0054a-0a2b-4b5f-b027-84c33b13d9bd admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.051773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0054a-0a2b-4b5f-b027-84c33b13d9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.054385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0054a-0a2b-4b5f-b027-84c33b13d9bd admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.073397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2092f6-cf25-4fd6-9989-78a8e57c1ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.074225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2092f6-cf25-4fd6-9989-78a8e57c1ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.074481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2092f6-cf25-4fd6-9989-78a8e57c1ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.074993 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2092f6-cf25-4fd6-9989-78a8e57c1ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.075766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2092f6-cf25-4fd6-9989-78a8e57c1ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.077530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2092f6-cf25-4fd6-9989-78a8e57c1ec8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.078301 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:32.090097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 934/1918] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:31 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:32.096076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0054a-0a2b-4b5f-b027-84c33b13d9bd admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.100411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 985/1919] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:32.105030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2092f6-cf25-4fd6-9989-78a8e57c1ec8 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.115450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0054a-0a2b-4b5f-b027-84c33b13d9bd admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.115850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2092f6-cf25-4fd6-9989-78a8e57c1ec8 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.122881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba5bd0-2086-4525-ab1c-441867e84345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.123841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba5bd0-2086-4525-ab1c-441867e84345 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.123982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba5bd0-2086-4525-ab1c-441867e84345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.124244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba5bd0-2086-4525-ab1c-441867e84345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.124987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba5bd0-2086-4525-ab1c-441867e84345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.125661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f10af6-6194-4128-bcca-4e4da24619fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.126576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba5bd0-2086-4525-ab1c-441867e84345 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.127808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f10af6-6194-4128-bcca-4e4da24619fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.128593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f10af6-6194-4128-bcca-4e4da24619fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.128968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f10af6-6194-4128-bcca-4e4da24619fa admin admin] PATH_INFO: `/v3/projects/e00b887f3f1c47138cf459b34c19820b/users/a1aa4a07edb343dda43f52b409d42e0e/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.149874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 935/1920] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:32.151523 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba5bd0-2086-4525-ab1c-441867e84345 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.169409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba5bd0-2086-4525-ab1c-441867e84345 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.174920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27d99c-44d9-4f9d-86e4-18c43742fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.176601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d99c-44d9-4f9d-86e4-18c43742fca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.176886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d99c-44d9-4f9d-86e4-18c43742fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.177165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27d99c-44d9-4f9d-86e4-18c43742fca4 admin admin] PATH_INFO: `/v3/projects/35514961f68c45f99a7f01ad193f21ca/users/72b06de07f11401f946212dfbc1e801c/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.179978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f10af6-6194-4128-bcca-4e4da24619fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00b887f3f1c47138cf459b34c19820b, user_id=a1aa4a07edb343dda43f52b409d42e0e, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.182757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f10af6-6194-4128-bcca-4e4da24619fa admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.195507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27d99c-44d9-4f9d-86e4-18c43742fca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35514961f68c45f99a7f01ad193f21ca, user_id=72b06de07f11401f946212dfbc1e801c, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.198272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27d99c-44d9-4f9d-86e4-18c43742fca4 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.199178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 986/1921] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:32 2022] PUT /identity/v3/projects/e00b887f3f1c47138cf459b34c19820b/users/a1aa4a07edb343dda43f52b409d42e0e/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:32.212117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006b021-2625-4d5a-bd40-2df39ff03e49 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.212967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006b021-2625-4d5a-bd40-2df39ff03e49 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.213810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006b021-2625-4d5a-bd40-2df39ff03e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.219096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 936/1922] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:32 2022] PUT /identity/v3/projects/35514961f68c45f99a7f01ad193f21ca/users/72b06de07f11401f946212dfbc1e801c/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:32.223484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27d99c-44d9-4f9d-86e4-18c43742fca4 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.245594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c006b021-2625-4d5a-bd40-2df39ff03e49 None None] MFA Rules not processed for user `a1aa4a07edb343dda43f52b409d42e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:32.246804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c006b021-2625-4d5a-bd40-2df39ff03e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:32.309938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27d99c-44d9-4f9d-86e4-18c43742fca4 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.332315 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902684b-7753-4f5e-91af-fb6b658411f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.333127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902684b-7753-4f5e-91af-fb6b658411f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.333601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902684b-7753-4f5e-91af-fb6b658411f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.333816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902684b-7753-4f5e-91af-fb6b658411f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.334867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902684b-7753-4f5e-91af-fb6b658411f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.336996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902684b-7753-4f5e-91af-fb6b658411f3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.354606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 937/1923] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:32.355811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902684b-7753-4f5e-91af-fb6b658411f3 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.358973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c902684b-7753-4f5e-91af-fb6b658411f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:32.366713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 987/1924] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:32.366713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006b021-2625-4d5a-bd40-2df39ff03e49 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.377096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006b021-2625-4d5a-bd40-2df39ff03e49 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.382163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902684b-7753-4f5e-91af-fb6b658411f3 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.385729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e33c73-4c95-4887-99e6-df8b632edb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.386769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e33c73-4c95-4887-99e6-df8b632edb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.387057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e33c73-4c95-4887-99e6-df8b632edb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.387348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e33c73-4c95-4887-99e6-df8b632edb18 admin admin] PATH_INFO: `/v3/projects/35514961f68c45f99a7f01ad193f21ca/users/72b06de07f11401f946212dfbc1e801c/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.388110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.389033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.389328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.389441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e33c73-4c95-4887-99e6-df8b632edb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35514961f68c45f99a7f01ad193f21ca, user_id=72b06de07f11401f946212dfbc1e801c, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.389602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] PATH_INFO: `/v3/projects/ed2f8c20575d4a8283e956b60b7cac5b` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.390978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2f8c20575d4a8283e956b60b7cac5b)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.392289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e33c73-4c95-4887-99e6-df8b632edb18 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.393217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.406178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 988/1925] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:32 2022] PUT /identity/v3/projects/35514961f68c45f99a7f01ad193f21ca/users/72b06de07f11401f946212dfbc1e801c/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:32.407730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e33c73-4c95-4887-99e6-df8b632edb18 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.477369 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2f8c20575d4a8283e956b60b7cac5b', 'request_id': 'req-290abd87-2dc2-4f8f-a63c-3f09984e11d8'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.488357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:32.501085 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2f8c20575d4a8283e956b60b7cac5b', 'request_id': 'req-290abd87-2dc2-4f8f-a63c-3f09984e11d8'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.510782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2f8c20575d4a8283e956b60b7cac5b', 'request_id': 'req-290abd87-2dc2-4f8f-a63c-3f09984e11d8'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.516314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e33c73-4c95-4887-99e6-df8b632edb18 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.525095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] The token cache is being invalidate because project ed2f8c20575d4a8283e956b60b7cac5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:32.526251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.527126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-290abd87-2dc2-4f8f-a63c-3f09984e11d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.528986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 938/1926] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:32 2022] DELETE /identity/v3/projects/ed2f8c20575d4a8283e956b60b7cac5b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:32.530622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c301-a162-407e-a439-fa869ec06550 None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.531108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c301-a162-407e-a439-fa869ec06550 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.531611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4c301-a162-407e-a439-fa869ec06550 None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.533164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 939/1927] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:32.534459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1fe8a-1316-423d-bb5c-7b3fa0aea859 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.534954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1fe8a-1316-423d-bb5c-7b3fa0aea859 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.535449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1fe8a-1316-423d-bb5c-7b3fa0aea859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.571171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-3cd1fe8a-1316-423d-bb5c-7b3fa0aea859 None None] MFA Rules not processed for user `72b06de07f11401f946212dfbc1e801c`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:32.584915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3cd1fe8a-1316-423d-bb5c-7b3fa0aea859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:32.591810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a825a8-2ea4-4e59-93ee-37d642e2abe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.592424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a825a8-2ea4-4e59-93ee-37d642e2abe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.593203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a825a8-2ea4-4e59-93ee-37d642e2abe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.593488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a825a8-2ea4-4e59-93ee-37d642e2abe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.594193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a825a8-2ea4-4e59-93ee-37d642e2abe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.597276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a825a8-2ea4-4e59-93ee-37d642e2abe0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.625722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:32.630321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 989/1928] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:32 2022] POST /identity/v3/projects => generated 407 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:32.631189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a825a8-2ea4-4e59-93ee-37d642e2abe0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.633228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c7a825a8-2ea4-4e59-93ee-37d642e2abe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:32.677582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 940/1929] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:32.679210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffcc57-e5d4-474e-9833-50a469bff358 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.679937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffcc57-e5d4-474e-9833-50a469bff358 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.680390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffcc57-e5d4-474e-9833-50a469bff358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.704012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-91ffcc57-e5d4-474e-9833-50a469bff358 None None] MFA Rules not processed for user `a0cc577feba04e66b950a69b918d4ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:32.705376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-91ffcc57-e5d4-474e-9833-50a469bff358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:32.711842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a825a8-2ea4-4e59-93ee-37d642e2abe0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.717473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.718677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.719148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.719637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] PATH_INFO: `/v3/users/c024661b88c943df869f23d6f0bbf2eb` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.721730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c024661b88c943df869f23d6f0bbf2eb)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.724103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.789105 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c024661b88c943df869f23d6f0bbf2eb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.799217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 941/1930] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:22:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:32.800042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c024661b88c943df869f23d6f0bbf2eb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.801087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffcc57-e5d4-474e-9833-50a469bff358 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.801804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c024661b88c943df869f23d6f0bbf2eb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.804524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-91ffcc57-e5d4-474e-9833-50a469bff358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:32.811897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c024661b88c943df869f23d6f0bbf2eb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.826643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:32.830930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c024661b88c943df869f23d6f0bbf2eb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:32.835529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffcc57-e5d4-474e-9833-50a469bff358 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.839787 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 990/1931] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:32 2022] DELETE /identity/v3/users/c024661b88c943df869f23d6f0bbf2eb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:32.840984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.841445 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400c479-80c2-40ac-bf63-0304474534cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.842382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400c479-80c2-40ac-bf63-0304474534cb admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.842873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400c479-80c2-40ac-bf63-0304474534cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.843143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:32.843669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400c479-80c2-40ac-bf63-0304474534cb admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.844605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400c479-80c2-40ac-bf63-0304474534cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:32.847183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400c479-80c2-40ac-bf63-0304474534cb admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:32.877020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 942/1932] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:32 2022] POST /identity/v3/users => generated 310 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:32.890699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400c479-80c2-40ac-bf63-0304474534cb admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:32.895547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d400c479-80c2-40ac-bf63-0304474534cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:32.920798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3188c-f7fe-44b9-8ee0-0914914bfe19 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.921054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400c479-80c2-40ac-bf63-0304474534cb admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:32.928535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:32.929508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:32.930016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:32.930495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:32.933244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.022502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.023986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.024732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.024732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.027982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.044004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.044978 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.046316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.047151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.061281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 943/1933] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:33.062353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 991/1934] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:33.072013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.077477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.135677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.138926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.158084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6c91-a342-47cb-98b1-17a17dc058b9 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.160431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:33.165874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8aba2-5760-4969-b791-97d495a0fcad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.168362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8aba2-5760-4969-b791-97d495a0fcad service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.168935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8aba2-5760-4969-b791-97d495a0fcad service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.169245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8aba2-5760-4969-b791-97d495a0fcad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.171597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4da8aba2-5760-4969-b791-97d495a0fcad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.199958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc53e1-14d2-4fa8-bafa-e22e92ab095b service placement] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.207879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c168f6a-12e4-4cfb-9f48-e9a4f8861c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.208582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168f6a-12e4-4cfb-9f48-e9a4f8861c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.208868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168f6a-12e4-4cfb-9f48-e9a4f8861c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.209147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c168f6a-12e4-4cfb-9f48-e9a4f8861c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.210478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c168f6a-12e4-4cfb-9f48-e9a4f8861c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.212504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c168f6a-12e4-4cfb-9f48-e9a4f8861c9e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.225256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 944/1935] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:33.232139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c168f6a-12e4-4cfb-9f48-e9a4f8861c9e admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.252034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c168f6a-12e4-4cfb-9f48-e9a4f8861c9e admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.258574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38ee78-0c98-41e0-b39f-45d2c3c237d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.261091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38ee78-0c98-41e0-b39f-45d2c3c237d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.262298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38ee78-0c98-41e0-b39f-45d2c3c237d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.262586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38ee78-0c98-41e0-b39f-45d2c3c237d8 admin admin] PATH_INFO: `/v3/projects/a9cf3877d6a74cde91c453b837aa8706/users/6209ef75f9204e44beed3e2f57da2d0c/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.285793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8aba2-5760-4969-b791-97d495a0fcad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.287892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8aba2-5760-4969-b791-97d495a0fcad service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.291712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38ee78-0c98-41e0-b39f-45d2c3c237d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cf3877d6a74cde91c453b837aa8706, user_id=6209ef75f9204e44beed3e2f57da2d0c, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.295268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38ee78-0c98-41e0-b39f-45d2c3c237d8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.308889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 992/1936] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:33.310267 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadcf1-7c57-486e-912c-9408bd961924 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.310555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadcf1-7c57-486e-912c-9408bd961924 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.310832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadcf1-7c57-486e-912c-9408bd961924 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.312457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 993/1937] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:22:33.315659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 945/1938] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:33 2022] PUT /identity/v3/projects/a9cf3877d6a74cde91c453b837aa8706/users/6209ef75f9204e44beed3e2f57da2d0c/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:33.319288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadcf1-7c57-486e-912c-9408bd961924 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.323883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615bef-b1e6-4248-b674-97cc01726855 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.324393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615bef-b1e6-4248-b674-97cc01726855 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.324681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615bef-b1e6-4248-b674-97cc01726855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.359364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d5615bef-b1e6-4248-b674-97cc01726855 None None] MFA Rules not processed for user `a0cc577feba04e66b950a69b918d4ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:33.360818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d5615bef-b1e6-4248-b674-97cc01726855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.439698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:33.488127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadcf1-7c57-486e-912c-9408bd961924 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.491377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 946/1939] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:33.492283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615bef-b1e6-4248-b674-97cc01726855 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.494686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d5615bef-b1e6-4248-b674-97cc01726855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.501171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a95fc-bc28-4ab6-a0d5-a007554ba9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.501865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a95fc-bc28-4ab6-a0d5-a007554ba9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.502282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a95fc-bc28-4ab6-a0d5-a007554ba9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.503219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a95fc-bc28-4ab6-a0d5-a007554ba9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.503331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a95fc-bc28-4ab6-a0d5-a007554ba9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.504906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a95fc-bc28-4ab6-a0d5-a007554ba9a2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.526385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615bef-b1e6-4248-b674-97cc01726855 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.527705 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 994/1940] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:33.528526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a95fc-bc28-4ab6-a0d5-a007554ba9a2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.530598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-909a95fc-bc28-4ab6-a0d5-a007554ba9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.534007 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.535181 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.535636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.536355 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] PATH_INFO: `/v3/projects/c1ea2e117e5149eb9608335d32b8a50a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.537539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ea2e117e5149eb9608335d32b8a50a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.539819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.544227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a95fc-bc28-4ab6-a0d5-a007554ba9a2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.550852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.551879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.552141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.552575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] PATH_INFO: `/v3/users/e88462be30d748209703da88ec037abe` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.554024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88462be30d748209703da88ec037abe)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.555895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.619690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ea2e117e5149eb9608335d32b8a50a', 'request_id': 'req-482fe660-74dc-4539-ba01-c212d017ac9d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.631819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ea2e117e5149eb9608335d32b8a50a', 'request_id': 'req-482fe660-74dc-4539-ba01-c212d017ac9d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.639163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88462be30d748209703da88ec037abe'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.644303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ea2e117e5149eb9608335d32b8a50a', 'request_id': 'req-482fe660-74dc-4539-ba01-c212d017ac9d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.649710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88462be30d748209703da88ec037abe'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.650588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88462be30d748209703da88ec037abe'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.664149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88462be30d748209703da88ec037abe'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.669332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] The token cache is being invalidate because project c1ea2e117e5149eb9608335d32b8a50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:33.670031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.672013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.678818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 947/1941] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:33 2022] DELETE /identity/v3/projects/c1ea2e117e5149eb9608335d32b8a50a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:33.680208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.682525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.701851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9004b696-fab6-41e2-b258-bf4c5b45902d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88462be30d748209703da88ec037abe'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:33.729581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 995/1942] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:33 2022] DELETE /identity/v3/users/e88462be30d748209703da88ec037abe => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:33.732376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271a90c-8215-4131-a40a-c90cd54c8042 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.733219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271a90c-8215-4131-a40a-c90cd54c8042 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.735842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271a90c-8215-4131-a40a-c90cd54c8042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.763302 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:33.806055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7271a90c-8215-4131-a40a-c90cd54c8042 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:33.811843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7271a90c-8215-4131-a40a-c90cd54c8042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.818137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482fe660-74dc-4539-ba01-c212d017ac9d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:33.913649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165e36-6013-47a7-9981-d0b51639c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:33.914378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165e36-6013-47a7-9981-d0b51639c806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.914732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165e36-6013-47a7-9981-d0b51639c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.915090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165e36-6013-47a7-9981-d0b51639c806 admin admin] PATH_INFO: `/v3/projects/a9cf3877d6a74cde91c453b837aa8706/users/6209ef75f9204e44beed3e2f57da2d0c/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:33.918179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a165e36-6013-47a7-9981-d0b51639c806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cf3877d6a74cde91c453b837aa8706, user_id=6209ef75f9204e44beed3e2f57da2d0c, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:33.921953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a165e36-6013-47a7-9981-d0b51639c806 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:33.949895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 948/1943] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:33 2022] PUT /identity/v3/projects/a9cf3877d6a74cde91c453b837aa8706/users/6209ef75f9204e44beed3e2f57da2d0c/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:33.950989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165e36-6013-47a7-9981-d0b51639c806 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:33.953395 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9a165e36-6013-47a7-9981-d0b51639c806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:33.992502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 996/1944] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:33.996549 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf10ff4-59d5-4f9b-84a9-a0a47651aaa8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:33.996848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf10ff4-59d5-4f9b-84a9-a0a47651aaa8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:33.997127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf10ff4-59d5-4f9b-84a9-a0a47651aaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.068869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dbf10ff4-59d5-4f9b-84a9-a0a47651aaa8 None None] MFA Rules not processed for user `6209ef75f9204e44beed3e2f57da2d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:34.070822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dbf10ff4-59d5-4f9b-84a9-a0a47651aaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:34.103068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165e36-6013-47a7-9981-d0b51639c806 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.122816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be98aa-bc27-4ec7-b69b-1bcfcf8977a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.123526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be98aa-bc27-4ec7-b69b-1bcfcf8977a9 service placement] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.123816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be98aa-bc27-4ec7-b69b-1bcfcf8977a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.124095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be98aa-bc27-4ec7-b69b-1bcfcf8977a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.130612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-27be98aa-bc27-4ec7-b69b-1bcfcf8977a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:34.142111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:34.147281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be98aa-bc27-4ec7-b69b-1bcfcf8977a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.149269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be98aa-bc27-4ec7-b69b-1bcfcf8977a9 service placement] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.166805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 949/1945] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:34.168651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f36b6-7fb1-4caa-a41c-399ac0a15a4e None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.169011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f36b6-7fb1-4caa-a41c-399ac0a15a4e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.169358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f36b6-7fb1-4caa-a41c-399ac0a15a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.192995 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-388f36b6-7fb1-4caa-a41c-399ac0a15a4e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:34.195103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-388f36b6-7fb1-4caa-a41c-399ac0a15a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:34.221870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 997/1946] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:34.236059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf10ff4-59d5-4f9b-84a9-a0a47651aaa8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.238130 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dbf10ff4-59d5-4f9b-84a9-a0a47651aaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:34.268430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:34.282993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 950/1947] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:34.284300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f36b6-7fb1-4caa-a41c-399ac0a15a4e None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.297780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f36b6-7fb1-4caa-a41c-399ac0a15a4e None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.303787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b64ab4-ab60-4ec5-841c-a0b9aee60a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.304639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b64ab4-ab60-4ec5-841c-a0b9aee60a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.305137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b64ab4-ab60-4ec5-841c-a0b9aee60a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.305493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b64ab4-ab60-4ec5-841c-a0b9aee60a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.306499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b64ab4-ab60-4ec5-841c-a0b9aee60a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:34.307452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b64ab4-ab60-4ec5-841c-a0b9aee60a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.309214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b64ab4-ab60-4ec5-841c-a0b9aee60a6b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.316039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf10ff4-59d5-4f9b-84a9-a0a47651aaa8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.320997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d853-fba2-4412-86ce-6f46e4cb66e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.321774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d853-fba2-4412-86ce-6f46e4cb66e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.322169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d853-fba2-4412-86ce-6f46e4cb66e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.322541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d853-fba2-4412-86ce-6f46e4cb66e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.327442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 951/1948] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:34.329958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b64ab4-ab60-4ec5-841c-a0b9aee60a6b admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.333973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5d853-fba2-4412-86ce-6f46e4cb66e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.335632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5d853-fba2-4412-86ce-6f46e4cb66e7 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.356359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b64ab4-ab60-4ec5-841c-a0b9aee60a6b admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.357690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 998/1949] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:34 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:22:34.363603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a0b2c-4e7c-45ed-980d-ffc87d7f8cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.364663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a0b2c-4e7c-45ed-980d-ffc87d7f8cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.365298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a0b2c-4e7c-45ed-980d-ffc87d7f8cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.365732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a0b2c-4e7c-45ed-980d-ffc87d7f8cc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.366944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a0b2c-4e7c-45ed-980d-ffc87d7f8cc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.370022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a0b2c-4e7c-45ed-980d-ffc87d7f8cc4 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.402107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 952/1950] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:34 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:34.406333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d853-fba2-4412-86ce-6f46e4cb66e7 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.422284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d853-fba2-4412-86ce-6f46e4cb66e7 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.558781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4896e-3f6d-4724-9296-ee3ad512db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.560530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4896e-3f6d-4724-9296-ee3ad512db51 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.560530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4896e-3f6d-4724-9296-ee3ad512db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.560530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4896e-3f6d-4724-9296-ee3ad512db51 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.561292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4896e-3f6d-4724-9296-ee3ad512db51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.566134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4896e-3f6d-4724-9296-ee3ad512db51 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.598189 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a0b2c-4e7c-45ed-980d-ffc87d7f8cc4 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.600594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f36a0b2c-4e7c-45ed-980d-ffc87d7f8cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:34.618500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 999/1951] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:34 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:34.620241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a0b2c-4e7c-45ed-980d-ffc87d7f8cc4 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.623270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4896e-3f6d-4724-9296-ee3ad512db51 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.632418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.643737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.644148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.646293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] PATH_INFO: `/v3/projects/100bebec45f94c43b8856b814a4e8195` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.646293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100bebec45f94c43b8856b814a4e8195)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.648535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4896e-3f6d-4724-9296-ee3ad512db51 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.648682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.655945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526f0ee-223f-44f6-86d4-5de89a82dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.657136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526f0ee-223f-44f6-86d4-5de89a82dd59 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.657616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526f0ee-223f-44f6-86d4-5de89a82dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.658133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526f0ee-223f-44f6-86d4-5de89a82dd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.659149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526f0ee-223f-44f6-86d4-5de89a82dd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.662165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526f0ee-223f-44f6-86d4-5de89a82dd59 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.698920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1000/1952] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:34.698920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526f0ee-223f-44f6-86d4-5de89a82dd59 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.765809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100bebec45f94c43b8856b814a4e8195', 'request_id': 'req-650b7205-dd15-402d-9385-8435a17e5d15'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:34.773481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100bebec45f94c43b8856b814a4e8195', 'request_id': 'req-650b7205-dd15-402d-9385-8435a17e5d15'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:34.782407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526f0ee-223f-44f6-86d4-5de89a82dd59 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.783277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100bebec45f94c43b8856b814a4e8195', 'request_id': 'req-650b7205-dd15-402d-9385-8435a17e5d15'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:34.795891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] The token cache is being invalidate because project 100bebec45f94c43b8856b814a4e8195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:34.796275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:34.796974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:34.797757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:34.799008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 953/1953] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:34 2022] DELETE /identity/v3/projects/100bebec45f94c43b8856b814a4e8195 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:34.799629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.801165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:34.849289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3f5f-467f-4c29-898d-d90be19bb3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.849943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3f5f-467f-4c29-898d-d90be19bb3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.850791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3f5f-467f-4c29-898d-d90be19bb3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.851075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f3f5f-467f-4c29-898d-d90be19bb3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.854465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ef3f3f5f-467f-4c29-898d-d90be19bb3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:34.874962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b7205-dd15-402d-9385-8435a17e5d15 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.880754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74a7a6-6335-4827-94a8-a209828fb27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.881467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74a7a6-6335-4827-94a8-a209828fb27f admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.881751 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74a7a6-6335-4827-94a8-a209828fb27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.882032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74a7a6-6335-4827-94a8-a209828fb27f admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.882764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74a7a6-6335-4827-94a8-a209828fb27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.884385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74a7a6-6335-4827-94a8-a209828fb27f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.895761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 954/1954] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:34.896749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74a7a6-6335-4827-94a8-a209828fb27f admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.903918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-bf74a7a6-6335-4827-94a8-a209828fb27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:34.917639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74a7a6-6335-4827-94a8-a209828fb27f admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.922996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.923125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f3f5f-467f-4c29-898d-d90be19bb3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.923940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.924234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.924513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] PATH_INFO: `/v3/users/38c75656a29847b68a11d672f7197bf9` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.925006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f3f5f-467f-4c29-898d-d90be19bb3b0 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.927051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c75656a29847b68a11d672f7197bf9)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.929115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:34.936124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1001/1955] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:34.937066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3f5f-467f-4c29-898d-d90be19bb3b0 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:34.955046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f3f5f-467f-4c29-898d-d90be19bb3b0 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:34.961555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89c6e-40f0-4eaf-851e-3ee61b1f5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:34.962641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89c6e-40f0-4eaf-851e-3ee61b1f5dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:34.962927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89c6e-40f0-4eaf-851e-3ee61b1f5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:34.963795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89c6e-40f0-4eaf-851e-3ee61b1f5dcb admin admin] PATH_INFO: `/v3/projects/a730a0ad45a84bceb1be39c4b5d0fa8b/users/6a675cf994ac4faaa6c63a25fd9cbd70/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:34.985863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a89c6e-40f0-4eaf-851e-3ee61b1f5dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a730a0ad45a84bceb1be39c4b5d0fa8b, user_id=6a675cf994ac4faaa6c63a25fd9cbd70, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:34.992650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a89c6e-40f0-4eaf-851e-3ee61b1f5dcb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.025193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1002/1956] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:34 2022] PUT /identity/v3/projects/a730a0ad45a84bceb1be39c4b5d0fa8b/users/6a675cf994ac4faaa6c63a25fd9cbd70/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:35.038045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c361-92ac-4a11-af8d-b156c693bc3e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.038344 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c361-92ac-4a11-af8d-b156c693bc3e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.038624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c361-92ac-4a11-af8d-b156c693bc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.047727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:35.069282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c75656a29847b68a11d672f7197bf9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.071790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c75656a29847b68a11d672f7197bf9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.101638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c75656a29847b68a11d672f7197bf9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.102526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c75656a29847b68a11d672f7197bf9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.126641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c75656a29847b68a11d672f7197bf9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.130821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ee50c361-92ac-4a11-af8d-b156c693bc3e None None] MFA Rules not processed for user `6a675cf994ac4faaa6c63a25fd9cbd70`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:35.134490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ee50c361-92ac-4a11-af8d-b156c693bc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:35.169002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 955/1957] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:34 2022] DELETE /identity/v3/users/38c75656a29847b68a11d672f7197bf9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:35.284452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1003/1958] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:35.295677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.297652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:35.402807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a7e77-8e08-4556-88cf-7352ab25bdac admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.419599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdef004-b1ed-45c0-9040-14a29193b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:35.420295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdef004-b1ed-45c0-9040-14a29193b0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.420574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdef004-b1ed-45c0-9040-14a29193b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.420850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdef004-b1ed-45c0-9040-14a29193b0d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.421547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdef004-b1ed-45c0-9040-14a29193b0d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:35.432221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdef004-b1ed-45c0-9040-14a29193b0d6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.458639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50c361-92ac-4a11-af8d-b156c693bc3e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.460953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ee50c361-92ac-4a11-af8d-b156c693bc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:35.476225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 956/1959] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:35 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:35.485061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdef004-b1ed-45c0-9040-14a29193b0d6 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.521240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:35.555319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50c361-92ac-4a11-af8d-b156c693bc3e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.601538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdef004-b1ed-45c0-9040-14a29193b0d6 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.607134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3c801-2f8f-42f9-bbaf-be70ab98610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:35.607847 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3c801-2f8f-42f9-bbaf-be70ab98610e admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.608140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3c801-2f8f-42f9-bbaf-be70ab98610e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.608417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3c801-2f8f-42f9-bbaf-be70ab98610e admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.609113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3c801-2f8f-42f9-bbaf-be70ab98610e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:35.611072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3c801-2f8f-42f9-bbaf-be70ab98610e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.632365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:35.633153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.636401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 957/1960] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:35 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:35.636554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.636554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] PATH_INFO: `/v3/projects/399545ed101e4e998d6c77041480ab91` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.636554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399545ed101e4e998d6c77041480ab91)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:35.636886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.637702 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3c801-2f8f-42f9-bbaf-be70ab98610e admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.647890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3c801-2f8f-42f9-bbaf-be70ab98610e admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.653134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c007481-7d9a-4dd8-a80c-3c7a6bdc131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:35.653914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c007481-7d9a-4dd8-a80c-3c7a6bdc131a admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.654303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c007481-7d9a-4dd8-a80c-3c7a6bdc131a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.654687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c007481-7d9a-4dd8-a80c-3c7a6bdc131a admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.655538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c007481-7d9a-4dd8-a80c-3c7a6bdc131a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:35.657116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c007481-7d9a-4dd8-a80c-3c7a6bdc131a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.668056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 958/1961] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:35.672445 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c007481-7d9a-4dd8-a80c-3c7a6bdc131a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.683630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c007481-7d9a-4dd8-a80c-3c7a6bdc131a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.689785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399545ed101e4e998d6c77041480ab91', 'request_id': 'req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.696042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:35.697526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399545ed101e4e998d6c77041480ab91', 'request_id': 'req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.703533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399545ed101e4e998d6c77041480ab91', 'request_id': 'req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.715233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] The token cache is being invalidate because project 399545ed101e4e998d6c77041480ab91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:35.715687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.716329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-81c18de4-a8ad-405c-b21a-cf613eb8dfa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:35.718068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1004/1962] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:35 2022] DELETE /identity/v3/projects/399545ed101e4e998d6c77041480ab91 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:35.723170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0557ba-f228-41dd-b702-20d5206867b3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.723512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0557ba-f228-41dd-b702-20d5206867b3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.723798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0557ba-f228-41dd-b702-20d5206867b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.742335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4f0557ba-f228-41dd-b702-20d5206867b3 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:35.743612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4f0557ba-f228-41dd-b702-20d5206867b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:35.746940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e643982-c125-41a5-a125-13a8f0771c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:35.747871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e643982-c125-41a5-a125-13a8f0771c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.748156 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e643982-c125-41a5-a125-13a8f0771c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.748434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e643982-c125-41a5-a125-13a8f0771c70 admin admin] PATH_INFO: `/v3/projects/ccc68907a99c4234b6309e8b530a484d/users/c654547f5b9b48abb06d7701029ba7ec/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.752148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1005/1963] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:35.759717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08d61-0fb8-41e6-8943-21f7c70d8097 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.760049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08d61-0fb8-41e6-8943-21f7c70d8097 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.760334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f08d61-0fb8-41e6-8943-21f7c70d8097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.763272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e643982-c125-41a5-a125-13a8f0771c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc68907a99c4234b6309e8b530a484d, user_id=c654547f5b9b48abb06d7701029ba7ec, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:35.766267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e643982-c125-41a5-a125-13a8f0771c70 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.778461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c8f08d61-0fb8-41e6-8943-21f7c70d8097 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:35.779711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c8f08d61-0fb8-41e6-8943-21f7c70d8097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:35.780413 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 959/1964] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:35 2022] PUT /identity/v3/projects/ccc68907a99c4234b6309e8b530a484d/users/c654547f5b9b48abb06d7701029ba7ec/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:35.784271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e643982-c125-41a5-a125-13a8f0771c70 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.785908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3e643982-c125-41a5-a125-13a8f0771c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:35.860347 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1006/1965] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:35.867387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f08d61-0fb8-41e6-8943-21f7c70d8097 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.876047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:35.877180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e643982-c125-41a5-a125-13a8f0771c70 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.882758 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9b1cc-8f50-43ff-85c5-7a89fbdca4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:35.883484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f08d61-0fb8-41e6-8943-21f7c70d8097 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.883592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9b1cc-8f50-43ff-85c5-7a89fbdca4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.883772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9b1cc-8f50-43ff-85c5-7a89fbdca4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.884103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9b1cc-8f50-43ff-85c5-7a89fbdca4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.884878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9b1cc-8f50-43ff-85c5-7a89fbdca4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:35.886724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9b1cc-8f50-43ff-85c5-7a89fbdca4f0 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.893378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19009d9b-4254-4e26-9ac0-ab858b8335a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:35.895109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19009d9b-4254-4e26-9ac0-ab858b8335a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.895441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19009d9b-4254-4e26-9ac0-ab858b8335a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.895754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19009d9b-4254-4e26-9ac0-ab858b8335a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.896508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19009d9b-4254-4e26-9ac0-ab858b8335a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:35.896820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19009d9b-4254-4e26-9ac0-ab858b8335a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:35.898568 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19009d9b-4254-4e26-9ac0-ab858b8335a4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.898904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 960/1966] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:35.904692 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9b1cc-8f50-43ff-85c5-7a89fbdca4f0 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.918950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9b1cc-8f50-43ff-85c5-7a89fbdca4f0 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.919817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1007/1967] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:35.924036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19009d9b-4254-4e26-9ac0-ab858b8335a4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:35.926058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8fb78-2ad7-4980-b0f7-debe6f254b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:35.927220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8fb78-2ad7-4980-b0f7-debe6f254b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.927573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8fb78-2ad7-4980-b0f7-debe6f254b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.927853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8fb78-2ad7-4980-b0f7-debe6f254b6b admin admin] PATH_INFO: `/v3/projects/ccc68907a99c4234b6309e8b530a484d/users/c654547f5b9b48abb06d7701029ba7ec/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.930046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8fb78-2ad7-4980-b0f7-debe6f254b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc68907a99c4234b6309e8b530a484d, user_id=c654547f5b9b48abb06d7701029ba7ec, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:35.932886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8fb78-2ad7-4980-b0f7-debe6f254b6b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:35.939836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19009d9b-4254-4e26-9ac0-ab858b8335a4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:35.946827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 961/1968] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:35 2022] PUT /identity/v3/projects/ccc68907a99c4234b6309e8b530a484d/users/c654547f5b9b48abb06d7701029ba7ec/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:35.959368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0a8d2-7d43-4150-ad6a-41caa69016a2 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:35.959368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0a8d2-7d43-4150-ad6a-41caa69016a2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:35.959368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0a8d2-7d43-4150-ad6a-41caa69016a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:35.996936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-00b0a8d2-7d43-4150-ad6a-41caa69016a2 None None] MFA Rules not processed for user `c654547f5b9b48abb06d7701029ba7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:35.998188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-00b0a8d2-7d43-4150-ad6a-41caa69016a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:36.038647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93833-2dc6-4c68-9989-85470e35c813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.039442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93833-2dc6-4c68-9989-85470e35c813 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.039805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93833-2dc6-4c68-9989-85470e35c813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.040154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93833-2dc6-4c68-9989-85470e35c813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.040925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c93833-2dc6-4c68-9989-85470e35c813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.043611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c93833-2dc6-4c68-9989-85470e35c813 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.074581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1008/1969] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:35 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:36.078359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93833-2dc6-4c68-9989-85470e35c813 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.090706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 962/1970] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:36.101852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0a8d2-7d43-4150-ad6a-41caa69016a2 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.104234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-00b0a8d2-7d43-4150-ad6a-41caa69016a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:36.124706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:36.162820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93833-2dc6-4c68-9989-85470e35c813 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.168157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd87ef1-01ef-49ee-8c60-656d8a061567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.168832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87ef1-01ef-49ee-8c60-656d8a061567 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.169125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87ef1-01ef-49ee-8c60-656d8a061567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.169492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd87ef1-01ef-49ee-8c60-656d8a061567 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.170192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd87ef1-01ef-49ee-8c60-656d8a061567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.172132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd87ef1-01ef-49ee-8c60-656d8a061567 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.180275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0a8d2-7d43-4150-ad6a-41caa69016a2 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.195524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1009/1971] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:36 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:36.198691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd87ef1-01ef-49ee-8c60-656d8a061567 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.209858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd87ef1-01ef-49ee-8c60-656d8a061567 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.215156 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e264d5c-da88-46f5-beae-64e4666d7807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.215864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e264d5c-da88-46f5-beae-64e4666d7807 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.216148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e264d5c-da88-46f5-beae-64e4666d7807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.216426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e264d5c-da88-46f5-beae-64e4666d7807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.217165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e264d5c-da88-46f5-beae-64e4666d7807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.218749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e264d5c-da88-46f5-beae-64e4666d7807 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.231372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1010/1972] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:36.234343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e264d5c-da88-46f5-beae-64e4666d7807 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.237972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63301278-93c9-431c-83c0-839e06d2e138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.238637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301278-93c9-431c-83c0-839e06d2e138 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.238918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301278-93c9-431c-83c0-839e06d2e138 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.239429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63301278-93c9-431c-83c0-839e06d2e138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.244728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e264d5c-da88-46f5-beae-64e4666d7807 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.249503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083cece-ea6a-46da-98fc-f0252ddd3ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.250310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083cece-ea6a-46da-98fc-f0252ddd3ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.250599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083cece-ea6a-46da-98fc-f0252ddd3ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.250875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083cece-ea6a-46da-98fc-f0252ddd3ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.251638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083cece-ea6a-46da-98fc-f0252ddd3ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.253219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083cece-ea6a-46da-98fc-f0252ddd3ae0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.266456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1011/1973] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:36.271078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083cece-ea6a-46da-98fc-f0252ddd3ae0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.282106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083cece-ea6a-46da-98fc-f0252ddd3ae0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.286691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7a4a6-3349-4c30-9356-11f6db1a3332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.287612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7a4a6-3349-4c30-9356-11f6db1a3332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.288272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7a4a6-3349-4c30-9356-11f6db1a3332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.288272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7a4a6-3349-4c30-9356-11f6db1a3332 admin admin] PATH_INFO: `/v3/projects/2fba356b4d7b43bc836f1752312ecf6e/users/cbccb1a2bb6d43e1a39beda15872b776/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.316658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63301278-93c9-431c-83c0-839e06d2e138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.318015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63301278-93c9-431c-83c0-839e06d2e138 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.325984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7a4a6-3349-4c30-9356-11f6db1a3332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fba356b4d7b43bc836f1752312ecf6e, user_id=cbccb1a2bb6d43e1a39beda15872b776, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.328700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7a4a6-3349-4c30-9356-11f6db1a3332 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.335122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 963/1974] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:36.354137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1012/1975] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:36 2022] PUT /identity/v3/projects/2fba356b4d7b43bc836f1752312ecf6e/users/cbccb1a2bb6d43e1a39beda15872b776/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:36.363975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fc735-bc43-413f-8c2e-5c58f3ec7a19 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.364273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fc735-bc43-413f-8c2e-5c58f3ec7a19 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.364678 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fc735-bc43-413f-8c2e-5c58f3ec7a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.397821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-356fc735-bc43-413f-8c2e-5c58f3ec7a19 None None] MFA Rules not processed for user `cbccb1a2bb6d43e1a39beda15872b776`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:36.400165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-356fc735-bc43-413f-8c2e-5c58f3ec7a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:36.477651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 964/1976] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:36.485892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7a4a6-3349-4c30-9356-11f6db1a3332 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.529543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:36.621169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7a4a6-3349-4c30-9356-11f6db1a3332 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.626538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6274-f3b8-4c79-99c3-848c95115b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.627603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6274-f3b8-4c79-99c3-848c95115b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.627603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6274-f3b8-4c79-99c3-848c95115b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.627907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6274-f3b8-4c79-99c3-848c95115b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.628610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6274-f3b8-4c79-99c3-848c95115b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.630567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6274-f3b8-4c79-99c3-848c95115b4d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.668157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1013/1977] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:36 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:36.672345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fc735-bc43-413f-8c2e-5c58f3ec7a19 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.679635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:36.686336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fc735-bc43-413f-8c2e-5c58f3ec7a19 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.768792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f56f-b312-4934-b836-8ed347c115d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.769483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f56f-b312-4934-b836-8ed347c115d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.769765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f56f-b312-4934-b836-8ed347c115d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.770035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f56f-b312-4934-b836-8ed347c115d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.770968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f56f-b312-4934-b836-8ed347c115d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.773057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f56f-b312-4934-b836-8ed347c115d7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.799820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 965/1978] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:36 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:36.801286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6274-f3b8-4c79-99c3-848c95115b4d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.831788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f56f-b312-4934-b836-8ed347c115d7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.836146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6274-f3b8-4c79-99c3-848c95115b4d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.838754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7476f56f-b312-4934-b836-8ed347c115d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:36.843427 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6325c-09d3-44f8-a35e-c2a7b015cd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.846720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6325c-09d3-44f8-a35e-c2a7b015cd2a admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.847091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6325c-09d3-44f8-a35e-c2a7b015cd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.847478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6325c-09d3-44f8-a35e-c2a7b015cd2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.848314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6325c-09d3-44f8-a35e-c2a7b015cd2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.849992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6325c-09d3-44f8-a35e-c2a7b015cd2a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.860231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f56f-b312-4934-b836-8ed347c115d7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.867764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.869020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.869738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.870203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] PATH_INFO: `/v3/users/7c9278a968834981a11b84dddbf4b3fa` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.871840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9278a968834981a11b84dddbf4b3fa)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.872299 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1014/1979] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:36.876840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.881963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6325c-09d3-44f8-a35e-c2a7b015cd2a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.899489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6325c-09d3-44f8-a35e-c2a7b015cd2a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.905094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffbc9b-bac0-4d81-9791-4940c9661063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.905831 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffbc9b-bac0-4d81-9791-4940c9661063 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.906124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffbc9b-bac0-4d81-9791-4940c9661063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.906421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffbc9b-bac0-4d81-9791-4940c9661063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.907848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffbc9b-bac0-4d81-9791-4940c9661063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.909703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffbc9b-bac0-4d81-9791-4940c9661063 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.927508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1015/1980] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:36.929808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffbc9b-bac0-4d81-9791-4940c9661063 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:36.942456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffbc9b-bac0-4d81-9791-4940c9661063 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:36.947846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241ed49-24c6-42f0-b187-75666727c334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:36.948858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241ed49-24c6-42f0-b187-75666727c334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:36.949226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241ed49-24c6-42f0-b187-75666727c334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:36.949507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241ed49-24c6-42f0-b187-75666727c334 admin admin] PATH_INFO: `/v3/projects/a1c50cf2771b46018bfc07a74352699a/users/ff9f70845a7f40148f616c47a63f2c24/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:36.970841 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241ed49-24c6-42f0-b187-75666727c334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c50cf2771b46018bfc07a74352699a, user_id=ff9f70845a7f40148f616c47a63f2c24, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:36.976083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9278a968834981a11b84dddbf4b3fa'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:36.976719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241ed49-24c6-42f0-b187-75666727c334 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:36.976827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9278a968834981a11b84dddbf4b3fa'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:36.991986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9278a968834981a11b84dddbf4b3fa'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:36.993842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9278a968834981a11b84dddbf4b3fa'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:36.995843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1016/1981] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:36 2022] PUT /identity/v3/projects/a1c50cf2771b46018bfc07a74352699a/users/ff9f70845a7f40148f616c47a63f2c24/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:37.006361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2b44294-02c0-407f-ba07-4bc0e0580b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9278a968834981a11b84dddbf4b3fa'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:37.007765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04e43-c8b6-4b1a-a65c-3d47ef498cc0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.008060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04e43-c8b6-4b1a-a65c-3d47ef498cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.009464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b04e43-c8b6-4b1a-a65c-3d47ef498cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.034324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 966/1982] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:36 2022] DELETE /identity/v3/users/7c9278a968834981a11b84dddbf4b3fa => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:37.044295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890c38f-777b-4350-ad1f-82ad22c8e372 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.044620 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890c38f-777b-4350-ad1f-82ad22c8e372 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.044955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890c38f-777b-4350-ad1f-82ad22c8e372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.054263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-77b04e43-c8b6-4b1a-a65c-3d47ef498cc0 None None] MFA Rules not processed for user `ff9f70845a7f40148f616c47a63f2c24`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:37.056058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-77b04e43-c8b6-4b1a-a65c-3d47ef498cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.068458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e890c38f-777b-4350-ad1f-82ad22c8e372 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:37.070331 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e890c38f-777b-4350-ad1f-82ad22c8e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.145289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1017/1983] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:37.146546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b04e43-c8b6-4b1a-a65c-3d47ef498cc0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.148016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-77b04e43-c8b6-4b1a-a65c-3d47ef498cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.180671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 967/1984] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:37.181450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890c38f-777b-4350-ad1f-82ad22c8e372 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.182925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e890c38f-777b-4350-ad1f-82ad22c8e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.201015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890c38f-777b-4350-ad1f-82ad22c8e372 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:37.209582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:37.211562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.211948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.212306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] PATH_INFO: `/v3/users/6a675cf994ac4faaa6c63a25fd9cbd70` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.215771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a675cf994ac4faaa6c63a25fd9cbd70)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:37.217996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:37.220401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:37.229194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:37.253569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b04e43-c8b6-4b1a-a65c-3d47ef498cc0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:37.262978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d96f6-7fe4-43f9-8cff-e188c4ad76fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:37.263808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d96f6-7fe4-43f9-8cff-e188c4ad76fa admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.264124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d96f6-7fe4-43f9-8cff-e188c4ad76fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.264396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d96f6-7fe4-43f9-8cff-e188c4ad76fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.265275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d96f6-7fe4-43f9-8cff-e188c4ad76fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:37.267941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d96f6-7fe4-43f9-8cff-e188c4ad76fa admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:37.296385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a675cf994ac4faaa6c63a25fd9cbd70'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:37.297164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a675cf994ac4faaa6c63a25fd9cbd70'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:37.306024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a675cf994ac4faaa6c63a25fd9cbd70'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:37.307602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1018/1985] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:37 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:37.308778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d96f6-7fe4-43f9-8cff-e188c4ad76fa admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.312297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a675cf994ac4faaa6c63a25fd9cbd70'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:37.313516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-946d96f6-7fe4-43f9-8cff-e188c4ad76fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.325350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a675cf994ac4faaa6c63a25fd9cbd70'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:37.353548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 968/1986] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:37 2022] DELETE /identity/v3/users/6a675cf994ac4faaa6c63a25fd9cbd70 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:37.354631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.356075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.398263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d96f6-7fe4-43f9-8cff-e188c4ad76fa admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:37.461900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf94f5-b69a-4c71-bf16-e34398a08fad admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:37.464988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a03fc8-206f-4ebf-83f5-b430b31a4a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:37.465878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a03fc8-206f-4ebf-83f5-b430b31a4a9b service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.466478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a03fc8-206f-4ebf-83f5-b430b31a4a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.466856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a03fc8-206f-4ebf-83f5-b430b31a4a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.467684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc5a26-cd99-4a11-9f21-85ef11c0a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:37.468784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5a26-cd99-4a11-9f21-85ef11c0a03f admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.468784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5a26-cd99-4a11-9f21-85ef11c0a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.469041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5a26-cd99-4a11-9f21-85ef11c0a03f admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.470522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc5a26-cd99-4a11-9f21-85ef11c0a03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:37.471414 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-59a03fc8-206f-4ebf-83f5-b430b31a4a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.472213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc5a26-cd99-4a11-9f21-85ef11c0a03f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:37.490215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a03fc8-206f-4ebf-83f5-b430b31a4a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:37.492550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a03fc8-206f-4ebf-83f5-b430b31a4a9b service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:37.503313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 969/1987] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:37 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:37.504890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0bf3d-35e2-4950-941c-de74d44f8290 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.505205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0bf3d-35e2-4950-941c-de74d44f8290 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.505471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0bf3d-35e2-4950-941c-de74d44f8290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.509833 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1019/1988] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:37.512254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a03fc8-206f-4ebf-83f5-b430b31a4a9b service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.526817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-25d0bf3d-35e2-4950-941c-de74d44f8290 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:37.528340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-25d0bf3d-35e2-4950-941c-de74d44f8290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.529788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a03fc8-206f-4ebf-83f5-b430b31a4a9b service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:37.535870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5417a-225f-4e06-aa85-19607d8173ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:37.536811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 970/1989] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:37.537107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5417a-225f-4e06-aa85-19607d8173ed admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.537819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5417a-225f-4e06-aa85-19607d8173ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.538322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5417a-225f-4e06-aa85-19607d8173ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.539449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5417a-225f-4e06-aa85-19607d8173ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:37.541565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5417a-225f-4e06-aa85-19607d8173ed admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:37.558381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1020/1990] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:37.562751 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0bf3d-35e2-4950-941c-de74d44f8290 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.573854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0bf3d-35e2-4950-941c-de74d44f8290 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:37.579371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64960f-1a5c-4d84-a6fb-679d48c607d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:37.579536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64960f-1a5c-4d84-a6fb-679d48c607d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.579818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64960f-1a5c-4d84-a6fb-679d48c607d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.580101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64960f-1a5c-4d84-a6fb-679d48c607d7 admin admin] PATH_INFO: `/v3/projects/c2650e74caf64d53ba592bdbe8f1e6c9/users/f6c93344f0bb4307ae41463f6cfd866c/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.598411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64960f-1a5c-4d84-a6fb-679d48c607d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2650e74caf64d53ba592bdbe8f1e6c9, user_id=f6c93344f0bb4307ae41463f6cfd866c, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:37.599404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5417a-225f-4e06-aa85-19607d8173ed admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.601212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64960f-1a5c-4d84-a6fb-679d48c607d7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:37.601875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-96a5417a-225f-4e06-aa85-19607d8173ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.620570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5417a-225f-4e06-aa85-19607d8173ed admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:37.622041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 971/1991] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:37 2022] PUT /identity/v3/projects/c2650e74caf64d53ba592bdbe8f1e6c9/users/f6c93344f0bb4307ae41463f6cfd866c/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:37.623010 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64960f-1a5c-4d84-a6fb-679d48c607d7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.673850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:37.702679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed3bca-50b0-4d1c-ab37-aa951064ff33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:37.703375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed3bca-50b0-4d1c-ab37-aa951064ff33 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.703702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed3bca-50b0-4d1c-ab37-aa951064ff33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.704022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64960f-1a5c-4d84-a6fb-679d48c607d7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:37.704133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed3bca-50b0-4d1c-ab37-aa951064ff33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.708880 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cda1c-d2d9-40e9-939f-871bc15c475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:37.709602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cda1c-d2d9-40e9-939f-871bc15c475d admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.709890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cda1c-d2d9-40e9-939f-871bc15c475d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.710169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cda1c-d2d9-40e9-939f-871bc15c475d admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.711110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cda1c-d2d9-40e9-939f-871bc15c475d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:37.715650 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cda1c-d2d9-40e9-939f-871bc15c475d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:37.716743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed3bca-50b0-4d1c-ab37-aa951064ff33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:37.718188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed3bca-50b0-4d1c-ab37-aa951064ff33 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:37.723872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 972/1992] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:37.727983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cda1c-d2d9-40e9-939f-871bc15c475d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.742196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cda1c-d2d9-40e9-939f-871bc15c475d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:37.742436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1021/1993] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:37.748198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b995c-5d08-4e28-8d6e-5c246fc92e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:37.749103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b995c-5d08-4e28-8d6e-5c246fc92e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.749387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b995c-5d08-4e28-8d6e-5c246fc92e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.749666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b995c-5d08-4e28-8d6e-5c246fc92e20 admin admin] PATH_INFO: `/v3/projects/c2650e74caf64d53ba592bdbe8f1e6c9/users/f6c93344f0bb4307ae41463f6cfd866c/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.752371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b995c-5d08-4e28-8d6e-5c246fc92e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2650e74caf64d53ba592bdbe8f1e6c9, user_id=f6c93344f0bb4307ae41463f6cfd866c, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:37.755174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b995c-5d08-4e28-8d6e-5c246fc92e20 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:37.770515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 973/1994] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:37 2022] PUT /identity/v3/projects/c2650e74caf64d53ba592bdbe8f1e6c9/users/f6c93344f0bb4307ae41463f6cfd866c/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:37.783698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c03b72-80d6-49ff-a767-c8773d0a1e00 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:37.783698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c03b72-80d6-49ff-a767-c8773d0a1e00 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:37.783698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c03b72-80d6-49ff-a767-c8773d0a1e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:37.834712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c7c03b72-80d6-49ff-a767-c8773d0a1e00 None None] MFA Rules not processed for user `f6c93344f0bb4307ae41463f6cfd866c`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:37.836065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c7c03b72-80d6-49ff-a767-c8773d0a1e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:37.855756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:37.956157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1022/1995] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:37.964680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b995c-5d08-4e28-8d6e-5c246fc92e20 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:37.967069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-588b995c-5d08-4e28-8d6e-5c246fc92e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:38.074024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b995c-5d08-4e28-8d6e-5c246fc92e20 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:38.078310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc401cc8-b39a-4b16-b08f-512f83dbd0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:38.078980 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc401cc8-b39a-4b16-b08f-512f83dbd0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:38.079264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc401cc8-b39a-4b16-b08f-512f83dbd0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:38.079574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc401cc8-b39a-4b16-b08f-512f83dbd0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:38.092234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc401cc8-b39a-4b16-b08f-512f83dbd0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:38.094155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc401cc8-b39a-4b16-b08f-512f83dbd0c0 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:38.122077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 974/1996] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:38.641836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c03b72-80d6-49ff-a767-c8773d0a1e00 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:38.644451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c7c03b72-80d6-49ff-a767-c8773d0a1e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:38.750404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc401cc8-b39a-4b16-b08f-512f83dbd0c0 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:38.753286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-bc401cc8-b39a-4b16-b08f-512f83dbd0c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:38.846781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c03b72-80d6-49ff-a767-c8773d0a1e00 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:38.856131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:38.857355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:38.857862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:38.858412 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] PATH_INFO: `/v3/projects/20f158307324417e993598494e210bb9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:38.860704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f158307324417e993598494e210bb9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:38.862800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:38.884110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc401cc8-b39a-4b16-b08f-512f83dbd0c0 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:38.898019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:38.899592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:38.901650 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:38.902049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] PATH_INFO: `/v3/projects/a730a0ad45a84bceb1be39c4b5d0fa8b` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:38.903844 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a730a0ad45a84bceb1be39c4b5d0fa8b)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:38.908107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:38.949023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f158307324417e993598494e210bb9', 'request_id': 'req-19c5cf08-9ab6-4050-8b62-e7998195e742'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:38.960943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f158307324417e993598494e210bb9', 'request_id': 'req-19c5cf08-9ab6-4050-8b62-e7998195e742'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:38.968457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f158307324417e993598494e210bb9', 'request_id': 'req-19c5cf08-9ab6-4050-8b62-e7998195e742'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:38.970972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a730a0ad45a84bceb1be39c4b5d0fa8b', 'request_id': 'req-9c5938b0-7a2b-4432-bd33-e29d420032e6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:38.978010 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a730a0ad45a84bceb1be39c4b5d0fa8b', 'request_id': 'req-9c5938b0-7a2b-4432-bd33-e29d420032e6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:38.981313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] The token cache is being invalidate because project 20f158307324417e993598494e210bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:38.981608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:38.982590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:38.991265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a730a0ad45a84bceb1be39c4b5d0fa8b', 'request_id': 'req-9c5938b0-7a2b-4432-bd33-e29d420032e6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:38.995823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:39.006212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1023/1997] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:38 2022] DELETE /identity/v3/projects/20f158307324417e993598494e210bb9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:39.006212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:39.006212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:39.015696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] The token cache is being invalidate because project a730a0ad45a84bceb1be39c4b5d0fa8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:39.016351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.017202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.019286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 975/1998] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:38 2022] DELETE /identity/v3/projects/a730a0ad45a84bceb1be39c4b5d0fa8b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:39.024511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:39.026904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:39.074034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:39.141722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5cf08-9ab6-4050-8b62-e7998195e742 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:39.235422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5938b0-7a2b-4432-bd33-e29d420032e6 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:39.251562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:39.252672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:39.252965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:39.253247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] PATH_INFO: `/v3/users/c654547f5b9b48abb06d7701029ba7ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:39.256740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c654547f5b9b48abb06d7701029ba7ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:39.259297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:39.290080 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:39.291026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:39.291312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:39.291616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] PATH_INFO: `/v3/users/258424bf2ed6437095116d10b0c2b088` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:39.296303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=258424bf2ed6437095116d10b0c2b088)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:39.298469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:39.355127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c654547f5b9b48abb06d7701029ba7ec'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.356009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c654547f5b9b48abb06d7701029ba7ec'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.368590 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c654547f5b9b48abb06d7701029ba7ec'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.369729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c654547f5b9b48abb06d7701029ba7ec'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.384458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c654547f5b9b48abb06d7701029ba7ec'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.407444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258424bf2ed6437095116d10b0c2b088'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.411386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 976/1999] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:39 2022] DELETE /identity/v3/users/c654547f5b9b48abb06d7701029ba7ec => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:39.415091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:39.415091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:39.422025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258424bf2ed6437095116d10b0c2b088'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.423675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258424bf2ed6437095116d10b0c2b088'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.444181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258424bf2ed6437095116d10b0c2b088'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.477890 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258424bf2ed6437095116d10b0c2b088'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:39.501082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1024/2000] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:39 2022] DELETE /identity/v3/users/258424bf2ed6437095116d10b0c2b088 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:39.541686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ac4af-385e-465c-9d0d-8d44e119d652 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:39.584266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:39.629715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dfd17-e603-4291-883d-cb635d42ae0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:39.630604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dfd17-e603-4291-883d-cb635d42ae0f service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:39.631654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dfd17-e603-4291-883d-cb635d42ae0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:39.632551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dfd17-e603-4291-883d-cb635d42ae0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:39.636345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-030dfd17-e603-4291-883d-cb635d42ae0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:39.730127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dfd17-e603-4291-883d-cb635d42ae0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:39.732363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dfd17-e603-4291-883d-cb635d42ae0f service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:39.747033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 977/2001] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:39.915701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:39.923165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:40.023643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1e9cf-3b34-485d-b007-86e4603ee08b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.029471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.030472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.030951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.031296 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] PATH_INFO: `/v3/projects/ccc68907a99c4234b6309e8b530a484d` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.032622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc68907a99c4234b6309e8b530a484d)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.034843 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.045803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:40.127088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc68907a99c4234b6309e8b530a484d', 'request_id': 'req-b44d0bc1-b737-4c8d-810d-247bd7823d9a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.137793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc68907a99c4234b6309e8b530a484d', 'request_id': 'req-b44d0bc1-b737-4c8d-810d-247bd7823d9a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.143749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc68907a99c4234b6309e8b530a484d', 'request_id': 'req-b44d0bc1-b737-4c8d-810d-247bd7823d9a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.157683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] The token cache is being invalidate because project ccc68907a99c4234b6309e8b530a484d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:40.157982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.158959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b44d0bc1-b737-4c8d-810d-247bd7823d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.163860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1025/2002] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:39 2022] DELETE /identity/v3/projects/ccc68907a99c4234b6309e8b530a484d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:40.169203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746302a-646e-40a5-bad7-4ab40b8ec509 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.169203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746302a-646e-40a5-bad7-4ab40b8ec509 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.169203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746302a-646e-40a5-bad7-4ab40b8ec509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.188165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-3746302a-646e-40a5-bad7-4ab40b8ec509 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:40.189754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3746302a-646e-40a5-bad7-4ab40b8ec509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:40.277112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 978/2003] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:40.284910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3600aa-fd6b-4fa1-a86b-97e3239a4d1c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.285213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3600aa-fd6b-4fa1-a86b-97e3239a4d1c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.285501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3600aa-fd6b-4fa1-a86b-97e3239a4d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.305818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-be3600aa-fd6b-4fa1-a86b-97e3239a4d1c None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:40.307647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-be3600aa-fd6b-4fa1-a86b-97e3239a4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:40.316533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1026/2004] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:40.322657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746302a-646e-40a5-bad7-4ab40b8ec509 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:40.338266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3600aa-fd6b-4fa1-a86b-97e3239a4d1c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:40.340175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-be3600aa-fd6b-4fa1-a86b-97e3239a4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:40.343403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746302a-646e-40a5-bad7-4ab40b8ec509 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.348930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483ae29-e2a4-4907-9af0-73c58784f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.349612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ae29-e2a4-4907-9af0-73c58784f108 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.349896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ae29-e2a4-4907-9af0-73c58784f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.350176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ae29-e2a4-4907-9af0-73c58784f108 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.350917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483ae29-e2a4-4907-9af0-73c58784f108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:40.351227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483ae29-e2a4-4907-9af0-73c58784f108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.353976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483ae29-e2a4-4907-9af0-73c58784f108 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.361314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3600aa-fd6b-4fa1-a86b-97e3239a4d1c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.370338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.370849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 979/2005] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:40.371537 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.372003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.372373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] PATH_INFO: `/v3/projects/a3658bac4afb4a6d866a335756d44b06` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.373931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3658bac4afb4a6d866a335756d44b06)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.375034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483ae29-e2a4-4907-9af0-73c58784f108 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:40.377522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.396610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483ae29-e2a4-4907-9af0-73c58784f108 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.404694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4ae42-e284-4ff0-bfbf-4bc8c1603ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.405429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4ae42-e284-4ff0-bfbf-4bc8c1603ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.405713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4ae42-e284-4ff0-bfbf-4bc8c1603ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.405989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4ae42-e284-4ff0-bfbf-4bc8c1603ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.406754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4ae42-e284-4ff0-bfbf-4bc8c1603ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.408977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4ae42-e284-4ff0-bfbf-4bc8c1603ab2 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.470127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 980/2006] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:40 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:40.473898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4ae42-e284-4ff0-bfbf-4bc8c1603ab2 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:40.485693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3658bac4afb4a6d866a335756d44b06', 'request_id': 'req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.496609 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3658bac4afb4a6d866a335756d44b06', 'request_id': 'req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.506230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3658bac4afb4a6d866a335756d44b06', 'request_id': 'req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.522768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] The token cache is being invalidate because project a3658bac4afb4a6d866a335756d44b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:40.523132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.524070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.529934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1027/2007] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:40 2022] DELETE /identity/v3/projects/a3658bac4afb4a6d866a335756d44b06 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:40.531162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:40.535371 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:40.571381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:40.600357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4ae42-e284-4ff0-bfbf-4bc8c1603ab2 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.617686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff477-f3ca-43ba-88c2-13bac798c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.618404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff477-f3ca-43ba-88c2-13bac798c9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.618692 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff477-f3ca-43ba-88c2-13bac798c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.619006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ff477-f3ca-43ba-88c2-13bac798c9cf admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.621909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ff477-f3ca-43ba-88c2-13bac798c9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.626438 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ff477-f3ca-43ba-88c2-13bac798c9cf admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.632960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034ee37-fbf2-4e92-94d4-2913ae4ffa4f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.651324 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.653591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.654206 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.655711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] PATH_INFO: `/v3/users/72b06de07f11401f946212dfbc1e801c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.662273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b06de07f11401f946212dfbc1e801c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.662273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.662456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 981/2008] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:40 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:40.663245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff477-f3ca-43ba-88c2-13bac798c9cf admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:40.667504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-902ff477-f3ca-43ba-88c2-13bac798c9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:40.698541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ff477-f3ca-43ba-88c2-13bac798c9cf admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.701931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:40.729642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea154f1-40aa-452a-823c-4247125fc682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.730726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea154f1-40aa-452a-823c-4247125fc682 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.731153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea154f1-40aa-452a-823c-4247125fc682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.733131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea154f1-40aa-452a-823c-4247125fc682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.733977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea154f1-40aa-452a-823c-4247125fc682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.740635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea154f1-40aa-452a-823c-4247125fc682 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.789581 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 982/2009] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:40.790542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea154f1-40aa-452a-823c-4247125fc682 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:40.801182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b06de07f11401f946212dfbc1e801c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.808045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea154f1-40aa-452a-823c-4247125fc682 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.810870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b06de07f11401f946212dfbc1e801c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.811645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b06de07f11401f946212dfbc1e801c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.814183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21056cb-c5b4-4285-b8cc-08c6d18de647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.817739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21056cb-c5b4-4285-b8cc-08c6d18de647 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.817739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21056cb-c5b4-4285-b8cc-08c6d18de647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.817739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21056cb-c5b4-4285-b8cc-08c6d18de647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.817739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21056cb-c5b4-4285-b8cc-08c6d18de647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.819301 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21056cb-c5b4-4285-b8cc-08c6d18de647 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.821346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b06de07f11401f946212dfbc1e801c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.832040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 983/2010] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:40.836990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21056cb-c5b4-4285-b8cc-08c6d18de647 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:40.841242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b21056cb-c5b4-4285-b8cc-08c6d18de647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:40.843626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b06de07f11401f946212dfbc1e801c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:40.851684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1028/2011] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:40 2022] DELETE /identity/v3/users/72b06de07f11401f946212dfbc1e801c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:40.858888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21056cb-c5b4-4285-b8cc-08c6d18de647 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.932258 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc05e27-6c57-4603-acde-08d64f16a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.934501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc05e27-6c57-4603-acde-08d64f16a982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.934501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc05e27-6c57-4603-acde-08d64f16a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.934501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc05e27-6c57-4603-acde-08d64f16a982 admin admin] PATH_INFO: `/v3/projects/e74c682c054d4a598139e097f889c966/users/dbe443fb65c44907bdda10967fed340e/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.942019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:40.943578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:40.953939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc05e27-6c57-4603-acde-08d64f16a982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74c682c054d4a598139e097f889c966, user_id=dbe443fb65c44907bdda10967fed340e, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.957117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc05e27-6c57-4603-acde-08d64f16a982 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.959097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5cff4-333e-43db-b7fe-fd954e503fe0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:40.965283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:40.966312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:40.966686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:40.967092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] PATH_INFO: `/v3/users/a1aa4a07edb343dda43f52b409d42e0e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:40.968510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1aa4a07edb343dda43f52b409d42e0e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:40.970543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:40.984863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 984/2012] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:40 2022] PUT /identity/v3/projects/e74c682c054d4a598139e097f889c966/users/dbe443fb65c44907bdda10967fed340e/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:41.008614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790af3e-8e77-4446-8313-5b1cf5f27156 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.009168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790af3e-8e77-4446-8313-5b1cf5f27156 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.009477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790af3e-8e77-4446-8313-5b1cf5f27156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.040917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1aa4a07edb343dda43f52b409d42e0e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.050618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1aa4a07edb343dda43f52b409d42e0e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.051489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1aa4a07edb343dda43f52b409d42e0e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.052160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b790af3e-8e77-4446-8313-5b1cf5f27156 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:41.055661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b790af3e-8e77-4446-8313-5b1cf5f27156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.060816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1aa4a07edb343dda43f52b409d42e0e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.076517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fa1cfacc-5e02-4bba-a584-193422c9c8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1aa4a07edb343dda43f52b409d42e0e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.107589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1029/2013] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:40 2022] DELETE /identity/v3/users/a1aa4a07edb343dda43f52b409d42e0e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:41.110161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240fad-3d3d-486a-8800-13dc283b20aa None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.112648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240fad-3d3d-486a-8800-13dc283b20aa None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.112648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240fad-3d3d-486a-8800-13dc283b20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.149150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-22240fad-3d3d-486a-8800-13dc283b20aa None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:41.151020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-22240fad-3d3d-486a-8800-13dc283b20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.218763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 985/2014] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:41.274216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790af3e-8e77-4446-8313-5b1cf5f27156 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.275902 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b790af3e-8e77-4446-8313-5b1cf5f27156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.301670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1030/2015] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:41.301670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240fad-3d3d-486a-8800-13dc283b20aa None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.302917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-22240fad-3d3d-486a-8800-13dc283b20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.316256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:41.321920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240fad-3d3d-486a-8800-13dc283b20aa None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.331248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.332790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.333146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.333615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] PATH_INFO: `/v3/projects/35514961f68c45f99a7f01ad193f21ca` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.342534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] RBAC: Authorizing `identity:delete_project(project_id=35514961f68c45f99a7f01ad193f21ca)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:41.345343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:41.388200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:41.410602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35514961f68c45f99a7f01ad193f21ca', 'request_id': 'req-ec1c577b-55c3-4898-8aad-e4b30934083c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.413967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790af3e-8e77-4446-8313-5b1cf5f27156 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.424676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35514961f68c45f99a7f01ad193f21ca', 'request_id': 'req-ec1c577b-55c3-4898-8aad-e4b30934083c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.434612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35514961f68c45f99a7f01ad193f21ca', 'request_id': 'req-ec1c577b-55c3-4898-8aad-e4b30934083c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.455200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] The token cache is being invalidate because project 35514961f68c45f99a7f01ad193f21ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:41.458369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.460728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:41.465259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1031/2016] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:41 2022] DELETE /identity/v3/projects/35514961f68c45f99a7f01ad193f21ca => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:41.474666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.476573 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.532222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aae3da-ec3b-484a-ba0c-f676f1cccd12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.533477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aae3da-ec3b-484a-ba0c-f676f1cccd12 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.533768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aae3da-ec3b-484a-ba0c-f676f1cccd12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.534046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aae3da-ec3b-484a-ba0c-f676f1cccd12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.536414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-48aae3da-ec3b-484a-ba0c-f676f1cccd12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.586053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c577b-55c3-4898-8aad-e4b30934083c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.591075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461ae9d-f784-4955-adf0-7d2be7d8a5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.591959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461ae9d-f784-4955-adf0-7d2be7d8a5da service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.592829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461ae9d-f784-4955-adf0-7d2be7d8a5da service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.593237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461ae9d-f784-4955-adf0-7d2be7d8a5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.595719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a461ae9d-f784-4955-adf0-7d2be7d8a5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.623605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aae3da-ec3b-484a-ba0c-f676f1cccd12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:41.625424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aae3da-ec3b-484a-ba0c-f676f1cccd12 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:41.640856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 986/2017] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:41.642544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18727bf6-3b2e-4a0e-88ed-3a099c36ae95 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.643054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18727bf6-3b2e-4a0e-88ed-3a099c36ae95 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.643630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18727bf6-3b2e-4a0e-88ed-3a099c36ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.673515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-18727bf6-3b2e-4a0e-88ed-3a099c36ae95 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:41.676080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-18727bf6-3b2e-4a0e-88ed-3a099c36ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.693158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 987/2018] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:41.702892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a0104-fd91-4bf8-a34c-f1e4e58bbeb5 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.704097 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a0104-fd91-4bf8-a34c-f1e4e58bbeb5 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.704654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a0104-fd91-4bf8-a34c-f1e4e58bbeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.708695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461ae9d-f784-4955-adf0-7d2be7d8a5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:41.712808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461ae9d-f784-4955-adf0-7d2be7d8a5da service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:41.724600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1032/2019] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:41.747687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e73a0104-fd91-4bf8-a34c-f1e4e58bbeb5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:41.750340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e73a0104-fd91-4bf8-a34c-f1e4e58bbeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:41.762778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 988/2020] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:41.767298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461ae9d-f784-4955-adf0-7d2be7d8a5da service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.782756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461ae9d-f784-4955-adf0-7d2be7d8a5da service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.792829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57c369-2765-4cf1-8291-78bf629a2ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.793773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57c369-2765-4cf1-8291-78bf629a2ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.794063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57c369-2765-4cf1-8291-78bf629a2ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.794894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57c369-2765-4cf1-8291-78bf629a2ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.795702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57c369-2765-4cf1-8291-78bf629a2ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:41.796628 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57c369-2765-4cf1-8291-78bf629a2ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:41.801413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57c369-2765-4cf1-8291-78bf629a2ab0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:41.821246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1033/2021] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:41.826488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a0104-fd91-4bf8-a34c-f1e4e58bbeb5 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.838482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a0104-fd91-4bf8-a34c-f1e4e58bbeb5 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.844421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834874a8-398c-4acb-b178-af26dea484b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.845155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834874a8-398c-4acb-b178-af26dea484b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.845455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834874a8-398c-4acb-b178-af26dea484b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.845807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834874a8-398c-4acb-b178-af26dea484b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.846860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834874a8-398c-4acb-b178-af26dea484b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:41.848837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834874a8-398c-4acb-b178-af26dea484b5 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:41.883385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 989/2022] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:41 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:41.885587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57c369-2765-4cf1-8291-78bf629a2ab0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:41.895939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57c369-2765-4cf1-8291-78bf629a2ab0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:41.921836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:41.966844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528d231-6ac7-4cbd-87b1-80a545cf4170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:41.967715 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528d231-6ac7-4cbd-87b1-80a545cf4170 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:41.968044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528d231-6ac7-4cbd-87b1-80a545cf4170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:41.968350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528d231-6ac7-4cbd-87b1-80a545cf4170 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:41.969064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528d231-6ac7-4cbd-87b1-80a545cf4170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:41.972043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528d231-6ac7-4cbd-87b1-80a545cf4170 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.000938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1034/2023] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:41 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:42.002111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834874a8-398c-4acb-b178-af26dea484b5 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:42.012945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834874a8-398c-4acb-b178-af26dea484b5 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:42.018353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb2954-cf97-44a5-91d3-2538065769db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:42.019233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb2954-cf97-44a5-91d3-2538065769db admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.019233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb2954-cf97-44a5-91d3-2538065769db admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.019577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb2954-cf97-44a5-91d3-2538065769db admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.020290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb2954-cf97-44a5-91d3-2538065769db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:42.022082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb2954-cf97-44a5-91d3-2538065769db admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.035136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 990/2024] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:42.038948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528d231-6ac7-4cbd-87b1-80a545cf4170 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:42.050035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528d231-6ac7-4cbd-87b1-80a545cf4170 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:42.054904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7678ff7-899b-4958-9ffc-f8480a291b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:42.055611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7678ff7-899b-4958-9ffc-f8480a291b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.055896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7678ff7-899b-4958-9ffc-f8480a291b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.056268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7678ff7-899b-4958-9ffc-f8480a291b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.057003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7678ff7-899b-4958-9ffc-f8480a291b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:42.058888 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7678ff7-899b-4958-9ffc-f8480a291b5c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.083480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1035/2025] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:42.087298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb2954-cf97-44a5-91d3-2538065769db admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:42.101526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb2954-cf97-44a5-91d3-2538065769db admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:42.108375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d1477-ea32-4395-b848-a8a1881de136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:42.110048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d1477-ea32-4395-b848-a8a1881de136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.110174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d1477-ea32-4395-b848-a8a1881de136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.110471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d1477-ea32-4395-b848-a8a1881de136 admin admin] PATH_INFO: `/v3/projects/4a2f407e90304e5e8599f82b66000cd4/users/6f6ef91bf64e4861a8e4d9e845d75195/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.129260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d1477-ea32-4395-b848-a8a1881de136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2f407e90304e5e8599f82b66000cd4, user_id=6f6ef91bf64e4861a8e4d9e845d75195, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:42.132342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d1477-ea32-4395-b848-a8a1881de136 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.152108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 991/2026] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:42 2022] PUT /identity/v3/projects/4a2f407e90304e5e8599f82b66000cd4/users/6f6ef91bf64e4861a8e4d9e845d75195/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:42.164595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a9c0e-405f-4a06-9594-78c64f07d4fc None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.164893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a9c0e-405f-4a06-9594-78c64f07d4fc None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.165234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a9c0e-405f-4a06-9594-78c64f07d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.226276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-259a9c0e-405f-4a06-9594-78c64f07d4fc None None] MFA Rules not processed for user `6f6ef91bf64e4861a8e4d9e845d75195`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:42.227736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-259a9c0e-405f-4a06-9594-78c64f07d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:42.366791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d1477-ea32-4395-b848-a8a1881de136 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:42.377873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1036/2027] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:42.415613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:42.461760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d1477-ea32-4395-b848-a8a1881de136 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:42.468870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437805f-230e-4cfe-8531-1deace577410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:42.470299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437805f-230e-4cfe-8531-1deace577410 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.470800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437805f-230e-4cfe-8531-1deace577410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.471626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437805f-230e-4cfe-8531-1deace577410 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.472646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437805f-230e-4cfe-8531-1deace577410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:42.475200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a9c0e-405f-4a06-9594-78c64f07d4fc None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:42.477013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-259a9c0e-405f-4a06-9594-78c64f07d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:42.481668 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437805f-230e-4cfe-8531-1deace577410 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.504739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a9c0e-405f-4a06-9594-78c64f07d4fc None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:42.522385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:42.524051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.524472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.524818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] PATH_INFO: `/v3/projects/e00b887f3f1c47138cf459b34c19820b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.526832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00b887f3f1c47138cf459b34c19820b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:42.528783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.563910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 992/2028] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:42 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:42.571772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437805f-230e-4cfe-8531-1deace577410 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:42.703720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00b887f3f1c47138cf459b34c19820b', 'request_id': 'req-58bcff0b-a52b-4d6d-977d-f3f94622f423'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:42.718615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00b887f3f1c47138cf459b34c19820b', 'request_id': 'req-58bcff0b-a52b-4d6d-977d-f3f94622f423'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:42.741352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00b887f3f1c47138cf459b34c19820b', 'request_id': 'req-58bcff0b-a52b-4d6d-977d-f3f94622f423'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:42.758485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] The token cache is being invalidate because project e00b887f3f1c47138cf459b34c19820b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:42.758782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:42.759590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:42.761836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1037/2029] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:42 2022] DELETE /identity/v3/projects/e00b887f3f1c47138cf459b34c19820b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:42.765783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:42.769721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:42.786050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437805f-230e-4cfe-8531-1deace577410 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:42.818500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:42.886102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22c4f3-60c0-4cf4-8fff-3c5ddbe7b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:42.886838 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22c4f3-60c0-4cf4-8fff-3c5ddbe7b37b admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.887139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22c4f3-60c0-4cf4-8fff-3c5ddbe7b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.887663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22c4f3-60c0-4cf4-8fff-3c5ddbe7b37b admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.888227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22c4f3-60c0-4cf4-8fff-3c5ddbe7b37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:42.890954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22c4f3-60c0-4cf4-8fff-3c5ddbe7b37b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.928517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bcff0b-a52b-4d6d-977d-f3f94622f423 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:42.935815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:42.936762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.937044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.937537 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] PATH_INFO: `/v3/users/6209ef75f9204e44beed3e2f57da2d0c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:42.937764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 993/2030] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:42 2022] POST /identity/v3/users => generated 297 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:42.938593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6209ef75f9204e44beed3e2f57da2d0c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:42.941732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:42.948682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b317ed-64e5-4866-9dac-93b165e3b550 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:42.948970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b317ed-64e5-4866-9dac-93b165e3b550 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:42.949246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b317ed-64e5-4866-9dac-93b165e3b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:43.051612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-68b317ed-64e5-4866-9dac-93b165e3b550 None None] MFA Rules not processed for user `dbe443fb65c44907bdda10967fed340e`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:43.052948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-68b317ed-64e5-4866-9dac-93b165e3b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:43.084612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6209ef75f9204e44beed3e2f57da2d0c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:43.097169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6209ef75f9204e44beed3e2f57da2d0c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:43.097169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6209ef75f9204e44beed3e2f57da2d0c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:43.107438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6209ef75f9204e44beed3e2f57da2d0c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:43.135232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6209ef75f9204e44beed3e2f57da2d0c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:43.160718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1038/2031] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:42 2022] DELETE /identity/v3/users/6209ef75f9204e44beed3e2f57da2d0c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:43.162304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:43.164061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:43.210053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:43.260641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 994/2032] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:43.265138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b317ed-64e5-4866-9dac-93b165e3b550 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:43.268083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-68b317ed-64e5-4866-9dac-93b165e3b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:43.305339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b317ed-64e5-4866-9dac-93b165e3b550 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:43.345837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af6ed2-a7ae-44c4-bd43-62614bdf852c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:43.360348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ea68d-9032-4864-ad7f-bea12ed3de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:43.361222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ea68d-9032-4864-ad7f-bea12ed3de38 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:43.362474 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ea68d-9032-4864-ad7f-bea12ed3de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:43.364886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ea68d-9032-4864-ad7f-bea12ed3de38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:43.365830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ea68d-9032-4864-ad7f-bea12ed3de38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:43.368885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ea68d-9032-4864-ad7f-bea12ed3de38 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:43.396104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1039/2033] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:43.402931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ea68d-9032-4864-ad7f-bea12ed3de38 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:43.418619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725798c1-79d9-48b3-9631-2ddc7c9b7a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:43.419868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725798c1-79d9-48b3-9631-2ddc7c9b7a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:43.419868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725798c1-79d9-48b3-9631-2ddc7c9b7a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:43.420064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725798c1-79d9-48b3-9631-2ddc7c9b7a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:43.421804 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725798c1-79d9-48b3-9631-2ddc7c9b7a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:43.424379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725798c1-79d9-48b3-9631-2ddc7c9b7a6c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:43.427095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ea68d-9032-4864-ad7f-bea12ed3de38 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:43.437495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23abca-f583-44ce-83b0-a86991f1dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:43.439277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23abca-f583-44ce-83b0-a86991f1dfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:43.442809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23abca-f583-44ce-83b0-a86991f1dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:43.443106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23abca-f583-44ce-83b0-a86991f1dfd1 admin admin] PATH_INFO: `/v3/projects/650477e839984679a85dc43620b4a520/users/8a984be45cfd423ba2b8cc90b609f854/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:43.467996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 995/2034] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:43 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:43.469103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725798c1-79d9-48b3-9631-2ddc7c9b7a6c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:43.477431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23abca-f583-44ce-83b0-a86991f1dfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650477e839984679a85dc43620b4a520, user_id=8a984be45cfd423ba2b8cc90b609f854, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:43.483401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23abca-f583-44ce-83b0-a86991f1dfd1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:43.505813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1040/2035] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:43 2022] PUT /identity/v3/projects/650477e839984679a85dc43620b4a520/users/8a984be45cfd423ba2b8cc90b609f854/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:43.509804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23abca-f583-44ce-83b0-a86991f1dfd1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:43.539773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:43.592809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725798c1-79d9-48b3-9631-2ddc7c9b7a6c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:43.634795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23abca-f583-44ce-83b0-a86991f1dfd1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:43.640282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea046e1-c30a-4a5f-b8a6-6572e03cd58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:43.641180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea046e1-c30a-4a5f-b8a6-6572e03cd58c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:43.655051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea046e1-c30a-4a5f-b8a6-6572e03cd58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:43.655380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea046e1-c30a-4a5f-b8a6-6572e03cd58c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:43.656192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea046e1-c30a-4a5f-b8a6-6572e03cd58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:43.657838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea046e1-c30a-4a5f-b8a6-6572e03cd58c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:43.684393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1041/2036] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:43.685263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea046e1-c30a-4a5f-b8a6-6572e03cd58c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:43.701662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea046e1-c30a-4a5f-b8a6-6572e03cd58c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:43.716586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66d2fa-ec6e-44e2-b043-4102f8d22379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:43.717693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66d2fa-ec6e-44e2-b043-4102f8d22379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:43.717991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66d2fa-ec6e-44e2-b043-4102f8d22379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:43.718275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66d2fa-ec6e-44e2-b043-4102f8d22379 admin admin] PATH_INFO: `/v3/projects/650477e839984679a85dc43620b4a520/users/8a984be45cfd423ba2b8cc90b609f854/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:43.724311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66d2fa-ec6e-44e2-b043-4102f8d22379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650477e839984679a85dc43620b4a520, user_id=8a984be45cfd423ba2b8cc90b609f854, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:43.731863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66d2fa-ec6e-44e2-b043-4102f8d22379 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:43.745012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4132e-1eb4-4a12-bae7-b70a919be36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:43.745714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4132e-1eb4-4a12-bae7-b70a919be36a admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:43.746001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4132e-1eb4-4a12-bae7-b70a919be36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:43.746547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4132e-1eb4-4a12-bae7-b70a919be36a admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:43.747435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4132e-1eb4-4a12-bae7-b70a919be36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:43.748433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1042/2037] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:43 2022] PUT /identity/v3/projects/650477e839984679a85dc43620b4a520/users/8a984be45cfd423ba2b8cc90b609f854/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:43.758968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141fb6-e9a1-41c3-b9eb-9a776309d270 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:43.759139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4132e-1eb4-4a12-bae7-b70a919be36a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:43.760226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141fb6-e9a1-41c3-b9eb-9a776309d270 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:43.760727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141fb6-e9a1-41c3-b9eb-9a776309d270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:43.787515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 996/2038] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:43 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:43.791290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4132e-1eb4-4a12-bae7-b70a919be36a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:43.796940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ba141fb6-e9a1-41c3-b9eb-9a776309d270 None None] MFA Rules not processed for user `8a984be45cfd423ba2b8cc90b609f854`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:43.798678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ba141fb6-e9a1-41c3-b9eb-9a776309d270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:43.802486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4132e-1eb4-4a12-bae7-b70a919be36a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:43.809326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:43.915328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5e2b0-010b-49c4-bfa7-e2e6fd5fb394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:43.916544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5e2b0-010b-49c4-bfa7-e2e6fd5fb394 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:43.917339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5e2b0-010b-49c4-bfa7-e2e6fd5fb394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:43.918042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5e2b0-010b-49c4-bfa7-e2e6fd5fb394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:43.919152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5e2b0-010b-49c4-bfa7-e2e6fd5fb394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:43.921127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5e2b0-010b-49c4-bfa7-e2e6fd5fb394 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:43.935690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 997/2039] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:43.938526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5e2b0-010b-49c4-bfa7-e2e6fd5fb394 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:43.964598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1043/2040] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:43.975691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5e2b0-010b-49c4-bfa7-e2e6fd5fb394 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:43.977272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141fb6-e9a1-41c3-b9eb-9a776309d270 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:43.979516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ba141fb6-e9a1-41c3-b9eb-9a776309d270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:43.992775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123a82c-c311-406b-ac90-0ae01b3803da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:43.993695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123a82c-c311-406b-ac90-0ae01b3803da admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:43.994021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123a82c-c311-406b-ac90-0ae01b3803da admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:43.994303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123a82c-c311-406b-ac90-0ae01b3803da admin admin] PATH_INFO: `/v3/projects/c1ec5cf0e4dc409893e83c55946120f9/users/2ff33d409a0a4b8c865e6a3b05abb456/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.016567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123a82c-c311-406b-ac90-0ae01b3803da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ec5cf0e4dc409893e83c55946120f9, user_id=2ff33d409a0a4b8c865e6a3b05abb456, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:44.019134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123a82c-c311-406b-ac90-0ae01b3803da admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:44.039681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 998/2041] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:43 2022] PUT /identity/v3/projects/c1ec5cf0e4dc409893e83c55946120f9/users/2ff33d409a0a4b8c865e6a3b05abb456/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:44.045103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123a82c-c311-406b-ac90-0ae01b3803da admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:44.121137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141fb6-e9a1-41c3-b9eb-9a776309d270 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:44.143836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123a82c-c311-406b-ac90-0ae01b3803da admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:44.162386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4f1f1-0906-4273-a49b-919247050ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:44.163083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4f1f1-0906-4273-a49b-919247050ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.163391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4f1f1-0906-4273-a49b-919247050ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.163675 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4f1f1-0906-4273-a49b-919247050ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.164418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4f1f1-0906-4273-a49b-919247050ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:44.166105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4f1f1-0906-4273-a49b-919247050ddc admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:44.176508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:44.199821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 999/2042] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:44.200951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4f1f1-0906-4273-a49b-919247050ddc admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:44.203932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-03c4f1f1-0906-4273-a49b-919247050ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:44.233905 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4f1f1-0906-4273-a49b-919247050ddc admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:44.235256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ff94b-153d-4a4d-b5ca-6c36cb130375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:44.235973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff94b-153d-4a4d-b5ca-6c36cb130375 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.236244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff94b-153d-4a4d-b5ca-6c36cb130375 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.236523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff94b-153d-4a4d-b5ca-6c36cb130375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.262055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:44.267623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.269251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.270088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] PATH_INFO: `/v3/projects/a9cf3877d6a74cde91c453b837aa8706` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.275276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9cf3877d6a74cde91c453b837aa8706)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:44.281198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:44.363984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9cf3877d6a74cde91c453b837aa8706', 'request_id': 'req-8aedcd62-d9b3-4c76-8713-c2c7694443e6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.400657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9cf3877d6a74cde91c453b837aa8706', 'request_id': 'req-8aedcd62-d9b3-4c76-8713-c2c7694443e6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.415122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9cf3877d6a74cde91c453b837aa8706', 'request_id': 'req-8aedcd62-d9b3-4c76-8713-c2c7694443e6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.443077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:44.443694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ff94b-153d-4a4d-b5ca-6c36cb130375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:44.445004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ff94b-153d-4a4d-b5ca-6c36cb130375 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:44.460431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] The token cache is being invalidate because project a9cf3877d6a74cde91c453b837aa8706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:44.460863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.461975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8aedcd62-d9b3-4c76-8713-c2c7694443e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.466588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1044/2043] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:22:44.467894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ff94b-153d-4a4d-b5ca-6c36cb130375 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:44.471901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1000/2044] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:44 2022] DELETE /identity/v3/projects/a9cf3877d6a74cde91c453b837aa8706 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:44.479510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab0ec0-20f9-410a-be0a-84563a817214 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.479807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab0ec0-20f9-410a-be0a-84563a817214 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.480093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab0ec0-20f9-410a-be0a-84563a817214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.497762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ff94b-153d-4a4d-b5ca-6c36cb130375 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:44.537798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-9eab0ec0-20f9-410a-be0a-84563a817214 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:44.539055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9eab0ec0-20f9-410a-be0a-84563a817214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:44.625097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c0ae6-16c4-4257-9b99-2673bb35a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:44.625097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c0ae6-16c4-4257-9b99-2673bb35a169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.625097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c0ae6-16c4-4257-9b99-2673bb35a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.625097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c0ae6-16c4-4257-9b99-2673bb35a169 admin admin] PATH_INFO: `/v3/projects/c1ec5cf0e4dc409893e83c55946120f9/users/2ff33d409a0a4b8c865e6a3b05abb456/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.628470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c0ae6-16c4-4257-9b99-2673bb35a169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ec5cf0e4dc409893e83c55946120f9, user_id=2ff33d409a0a4b8c865e6a3b05abb456, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:44.637894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c0ae6-16c4-4257-9b99-2673bb35a169 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:44.671057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1045/2045] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:44 2022] PUT /identity/v3/projects/c1ec5cf0e4dc409893e83c55946120f9/users/2ff33d409a0a4b8c865e6a3b05abb456/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:44.672646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c0ae6-16c4-4257-9b99-2673bb35a169 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:44.674001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1001/2046] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:44.674918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9c9c0ae6-16c4-4257-9b99-2673bb35a169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:44.675053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab0ec0-20f9-410a-be0a-84563a817214 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:44.681136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9eab0ec0-20f9-410a-be0a-84563a817214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:44.699313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab0ec0-20f9-410a-be0a-84563a817214 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:44.772309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:44.773509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c0ae6-16c4-4257-9b99-2673bb35a169 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:44.773658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.773945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.774227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] PATH_INFO: `/v3/users/c1c14d9018eb4c60962b013392995343` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.775648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c14d9018eb4c60962b013392995343)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:44.777938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:44.780258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020deced-1e0d-46b7-b218-c05049938578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:44.781868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020deced-1e0d-46b7-b218-c05049938578 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.783269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020deced-1e0d-46b7-b218-c05049938578 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.783807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020deced-1e0d-46b7-b218-c05049938578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.787924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-020deced-1e0d-46b7-b218-c05049938578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:44.836602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:44.859883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c14d9018eb4c60962b013392995343'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.860624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c14d9018eb4c60962b013392995343'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.869448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c14d9018eb4c60962b013392995343'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.870205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c14d9018eb4c60962b013392995343'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.879492 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c14d9018eb4c60962b013392995343'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:44.883942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020deced-1e0d-46b7-b218-c05049938578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:44.885761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020deced-1e0d-46b7-b218-c05049938578 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:44.907472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1002/2047] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:44 2022] DELETE /identity/v3/users/c1c14d9018eb4c60962b013392995343 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:44.909214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:44.909693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1046/2048] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:44.911484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88eb59-27c8-4251-a8ce-ec7bb9d242f9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:44.911602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88eb59-27c8-4251-a8ce-ec7bb9d242f9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:44.913560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88eb59-27c8-4251-a8ce-ec7bb9d242f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:44.913925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:44.948367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:44.955540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9b88eb59-27c8-4251-a8ce-ec7bb9d242f9 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:44.956792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9b88eb59-27c8-4251-a8ce-ec7bb9d242f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.015076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f89669-94ff-4fe0-ab3e-391653ed52e7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.019765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c471ec-0a58-4171-9adb-8db833786d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.020717 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c471ec-0a58-4171-9adb-8db833786d86 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.021105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c471ec-0a58-4171-9adb-8db833786d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.021485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c471ec-0a58-4171-9adb-8db833786d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.023747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-35c471ec-0a58-4171-9adb-8db833786d86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.103053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1047/2049] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:45.107281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88eb59-27c8-4251-a8ce-ec7bb9d242f9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.131533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88eb59-27c8-4251-a8ce-ec7bb9d242f9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.138942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c471ec-0a58-4171-9adb-8db833786d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.141713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c471ec-0a58-4171-9adb-8db833786d86 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.142633 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed2132-a700-4879-a41d-c818e4e34813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.143317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed2132-a700-4879-a41d-c818e4e34813 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.143630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed2132-a700-4879-a41d-c818e4e34813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.143906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed2132-a700-4879-a41d-c818e4e34813 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.144656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed2132-a700-4879-a41d-c818e4e34813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:45.144968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed2132-a700-4879-a41d-c818e4e34813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.146603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed2132-a700-4879-a41d-c818e4e34813 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.155326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1003/2050] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:45.174374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1048/2051] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:45.176201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c471ec-0a58-4171-9adb-8db833786d86 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.200248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c471ec-0a58-4171-9adb-8db833786d86 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.210044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d5492-0195-42f6-adaa-3f070d69e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.211041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5492-0195-42f6-adaa-3f070d69e2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.211611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5492-0195-42f6-adaa-3f070d69e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.212048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5492-0195-42f6-adaa-3f070d69e2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.213648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d5492-0195-42f6-adaa-3f070d69e2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.216619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d5492-0195-42f6-adaa-3f070d69e2f9 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.256345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1004/2052] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:45 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:45.257882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed2132-a700-4879-a41d-c818e4e34813 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.275966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed2132-a700-4879-a41d-c818e4e34813 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.291300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d5492-0195-42f6-adaa-3f070d69e2f9 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.294167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5c2d5492-0195-42f6-adaa-3f070d69e2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.398905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14bfdb-bc9d-435c-9d97-3258335eb43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.399292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14bfdb-bc9d-435c-9d97-3258335eb43b admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.399783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14bfdb-bc9d-435c-9d97-3258335eb43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.403520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14bfdb-bc9d-435c-9d97-3258335eb43b admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.404352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14bfdb-bc9d-435c-9d97-3258335eb43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.404855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d5492-0195-42f6-adaa-3f070d69e2f9 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.407037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14bfdb-bc9d-435c-9d97-3258335eb43b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.413848 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.415545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.416115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.416547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] PATH_INFO: `/v3/users/6f6ef91bf64e4861a8e4d9e845d75195` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.419832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6ef91bf64e4861a8e4d9e845d75195)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.420314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.442862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1049/2053] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:45 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:45.447441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14bfdb-bc9d-435c-9d97-3258335eb43b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.451997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3f14bfdb-bc9d-435c-9d97-3258335eb43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.482170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14bfdb-bc9d-435c-9d97-3258335eb43b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.494279 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.495124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.495439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.495723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] PATH_INFO: `/v3/projects/bc7ff8b3d32245e2b421b7e8f75c20fb` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.501401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7ff8b3d32245e2b421b7e8f75c20fb)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.505571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.518536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6ef91bf64e4861a8e4d9e845d75195'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.519708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6ef91bf64e4861a8e4d9e845d75195'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.531392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6ef91bf64e4861a8e4d9e845d75195'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.531897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:45.533400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6ef91bf64e4861a8e4d9e845d75195'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.544200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6ef91bf64e4861a8e4d9e845d75195'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.570889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:45.574006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1005/2054] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:45 2022] DELETE /identity/v3/users/6f6ef91bf64e4861a8e4d9e845d75195 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:45.574934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.576596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.586172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7ff8b3d32245e2b421b7e8f75c20fb', 'request_id': 'req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.602016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7ff8b3d32245e2b421b7e8f75c20fb', 'request_id': 'req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.612064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7ff8b3d32245e2b421b7e8f75c20fb', 'request_id': 'req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.632216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] The token cache is being invalidate because project bc7ff8b3d32245e2b421b7e8f75c20fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:45.632774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.634088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2e6900ce-36e1-4d5c-bc22-4c51e9d0e749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:45.637088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1050/2055] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:45 2022] DELETE /identity/v3/projects/bc7ff8b3d32245e2b421b7e8f75c20fb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:45.639541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c5d96-f6a2-4417-92ff-68b11065a650 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.640130 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c5d96-f6a2-4417-92ff-68b11065a650 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.641251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c5d96-f6a2-4417-92ff-68b11065a650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.661276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9029d-34e6-4f08-a7f2-bc5533f34783 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.664461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-463c5d96-f6a2-4417-92ff-68b11065a650 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:45.665930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-463c5d96-f6a2-4417-92ff-68b11065a650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.667051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6c637-9bf6-49c9-b021-5cafaccd3865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.667814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6c637-9bf6-49c9-b021-5cafaccd3865 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.668103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6c637-9bf6-49c9-b021-5cafaccd3865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.668657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6c637-9bf6-49c9-b021-5cafaccd3865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.669419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6c637-9bf6-49c9-b021-5cafaccd3865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.671214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6c637-9bf6-49c9-b021-5cafaccd3865 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.676650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1051/2056] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:45.678943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971e62b-95db-477b-9162-c627507a5785 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.679530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971e62b-95db-477b-9162-c627507a5785 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.679956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971e62b-95db-477b-9162-c627507a5785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.687871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1006/2057] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:45.689138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6c637-9bf6-49c9-b021-5cafaccd3865 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.691255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-28b6c637-9bf6-49c9-b021-5cafaccd3865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.707004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3971e62b-95db-477b-9162-c627507a5785 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:45.709270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3971e62b-95db-477b-9162-c627507a5785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.723317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1052/2058] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:45.724551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971e62b-95db-477b-9162-c627507a5785 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.726194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3971e62b-95db-477b-9162-c627507a5785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.746871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971e62b-95db-477b-9162-c627507a5785 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.754654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd02d4b-47d9-48e1-95ea-33478c2ded0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.755430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd02d4b-47d9-48e1-95ea-33478c2ded0e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.755758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd02d4b-47d9-48e1-95ea-33478c2ded0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.756979 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd02d4b-47d9-48e1-95ea-33478c2ded0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.757596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd02d4b-47d9-48e1-95ea-33478c2ded0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.760654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd02d4b-47d9-48e1-95ea-33478c2ded0e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.777815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1053/2059] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:45.777815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510f8f-d69a-4e80-8677-b9564043feb7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.777815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510f8f-d69a-4e80-8677-b9564043feb7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.777815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510f8f-d69a-4e80-8677-b9564043feb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.782263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6c637-9bf6-49c9-b021-5cafaccd3865 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.786641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66055b-53ac-4d97-83ca-f82f2e9d31ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.787299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66055b-53ac-4d97-83ca-f82f2e9d31ba service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.787616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66055b-53ac-4d97-83ca-f82f2e9d31ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.787899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66055b-53ac-4d97-83ca-f82f2e9d31ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.798560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ee510f8f-d69a-4e80-8677-b9564043feb7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:45.799790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66055b-53ac-4d97-83ca-f82f2e9d31ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.799959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ee510f8f-d69a-4e80-8677-b9564043feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:45.802690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66055b-53ac-4d97-83ca-f82f2e9d31ba service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.812064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1054/2060] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:45.813265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510f8f-d69a-4e80-8677-b9564043feb7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.817055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1007/2061] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:45.818282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66055b-53ac-4d97-83ca-f82f2e9d31ba service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.832597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510f8f-d69a-4e80-8677-b9564043feb7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.832875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66055b-53ac-4d97-83ca-f82f2e9d31ba service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.849859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a462a8-d3f6-4261-a839-4574b7bbe7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.850877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a462a8-d3f6-4261-a839-4574b7bbe7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.851232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a462a8-d3f6-4261-a839-4574b7bbe7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.851610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a462a8-d3f6-4261-a839-4574b7bbe7b9 admin admin] PATH_INFO: `/v3/projects/b8d27cf7c3cc433e8571b951587cf510/users/98170294307245099b8d760bf108beac/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.855364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788d2da-d7a5-42e0-acc0-2a0b62f2285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:45.856127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788d2da-d7a5-42e0-acc0-2a0b62f2285f admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.856425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788d2da-d7a5-42e0-acc0-2a0b62f2285f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.857178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788d2da-d7a5-42e0-acc0-2a0b62f2285f admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:45.860153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788d2da-d7a5-42e0-acc0-2a0b62f2285f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:45.860495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788d2da-d7a5-42e0-acc0-2a0b62f2285f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.865640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788d2da-d7a5-42e0-acc0-2a0b62f2285f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.889186 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a462a8-d3f6-4261-a839-4574b7bbe7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d27cf7c3cc433e8571b951587cf510, user_id=98170294307245099b8d760bf108beac, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:45.893126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a462a8-d3f6-4261-a839-4574b7bbe7b9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:45.906247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1008/2062] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:45.910736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788d2da-d7a5-42e0-acc0-2a0b62f2285f admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:45.928816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1055/2063] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:45 2022] PUT /identity/v3/projects/b8d27cf7c3cc433e8571b951587cf510/users/98170294307245099b8d760bf108beac/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:45.936167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788d2da-d7a5-42e0-acc0-2a0b62f2285f admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:45.939431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310553-e8b7-486c-825b-15bf0d5b1dea None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:45.939869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310553-e8b7-486c-825b-15bf0d5b1dea None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:45.940415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310553-e8b7-486c-825b-15bf0d5b1dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:46.055837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4a310553-e8b7-486c-825b-15bf0d5b1dea None None] MFA Rules not processed for user `98170294307245099b8d760bf108beac`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:46.058419 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4a310553-e8b7-486c-825b-15bf0d5b1dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:46.061082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:46.071545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e738b-6673-4472-8143-5516145e8b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:46.073116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e738b-6673-4472-8143-5516145e8b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:46.073874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e738b-6673-4472-8143-5516145e8b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:46.074299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e738b-6673-4472-8143-5516145e8b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:46.077504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e738b-6673-4472-8143-5516145e8b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:46.081649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e738b-6673-4472-8143-5516145e8b82 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:46.135362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1009/2064] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:45 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:46.139190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e738b-6673-4472-8143-5516145e8b82 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:46.195067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1056/2065] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:46.208242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310553-e8b7-486c-825b-15bf0d5b1dea None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:46.210230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4a310553-e8b7-486c-825b-15bf0d5b1dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:46.260507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e738b-6673-4472-8143-5516145e8b82 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:46.266892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc201f6-8bda-437b-be37-b59c1e70837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:46.267822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc201f6-8bda-437b-be37-b59c1e70837d admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:46.268175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc201f6-8bda-437b-be37-b59c1e70837d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:46.268537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc201f6-8bda-437b-be37-b59c1e70837d admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:46.269566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc201f6-8bda-437b-be37-b59c1e70837d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:46.272349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc201f6-8bda-437b-be37-b59c1e70837d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:46.300923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1010/2066] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:46 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:46.304813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310553-e8b7-486c-825b-15bf0d5b1dea None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:46.307032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc201f6-8bda-437b-be37-b59c1e70837d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:46.325384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc201f6-8bda-437b-be37-b59c1e70837d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:46.332281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae549ecf-fd20-41cf-8e3f-9b60823df3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:46.333215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae549ecf-fd20-41cf-8e3f-9b60823df3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:46.333630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae549ecf-fd20-41cf-8e3f-9b60823df3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:46.333977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae549ecf-fd20-41cf-8e3f-9b60823df3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:46.334888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae549ecf-fd20-41cf-8e3f-9b60823df3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:46.337373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae549ecf-fd20-41cf-8e3f-9b60823df3a7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:46.346122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:46.364153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1011/2067] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:46.365908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae549ecf-fd20-41cf-8e3f-9b60823df3a7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:46.387937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae549ecf-fd20-41cf-8e3f-9b60823df3a7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:46.404525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b080-7ff6-4356-8bb0-2655c1db53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:46.405219 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b080-7ff6-4356-8bb0-2655c1db53aa admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:46.405522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b080-7ff6-4356-8bb0-2655c1db53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:46.406226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b080-7ff6-4356-8bb0-2655c1db53aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:46.409901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b080-7ff6-4356-8bb0-2655c1db53aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:46.414058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b080-7ff6-4356-8bb0-2655c1db53aa admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:46.420025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b20df-ff6f-4c1d-a3d9-4cb976e6a1f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:46.421323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b20df-ff6f-4c1d-a3d9-4cb976e6a1f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:46.421738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b20df-ff6f-4c1d-a3d9-4cb976e6a1f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:46.422208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b20df-ff6f-4c1d-a3d9-4cb976e6a1f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:46.446310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1012/2068] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:46.449107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b080-7ff6-4356-8bb0-2655c1db53aa admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:46.466371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b080-7ff6-4356-8bb0-2655c1db53aa admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:46.473228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184dff2-6a4e-47bc-b7f2-2fe873f6fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:46.474686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184dff2-6a4e-47bc-b7f2-2fe873f6fc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:46.475820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184dff2-6a4e-47bc-b7f2-2fe873f6fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:46.476112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184dff2-6a4e-47bc-b7f2-2fe873f6fc04 admin admin] PATH_INFO: `/v3/projects/e408c30513b14be489e6b72248f359cc/users/05ba6d637a31453b88ba4c18b47697b6/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:46.496584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184dff2-6a4e-47bc-b7f2-2fe873f6fc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e408c30513b14be489e6b72248f359cc, user_id=05ba6d637a31453b88ba4c18b47697b6, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:46.501998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184dff2-6a4e-47bc-b7f2-2fe873f6fc04 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:46.531806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1013/2069] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:46 2022] PUT /identity/v3/projects/e408c30513b14be489e6b72248f359cc/users/05ba6d637a31453b88ba4c18b47697b6/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:46.533786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10530ff-9e0a-4510-9610-66af90a63492 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:46.534077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10530ff-9e0a-4510-9610-66af90a63492 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:46.534589 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10530ff-9e0a-4510-9610-66af90a63492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:46.586062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d10530ff-9e0a-4510-9610-66af90a63492 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:46.587854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d10530ff-9e0a-4510-9610-66af90a63492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:46.598334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b20df-ff6f-4c1d-a3d9-4cb976e6a1f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:46.603891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b20df-ff6f-4c1d-a3d9-4cb976e6a1f8 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:46.634985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1057/2070] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:46.655262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b20df-ff6f-4c1d-a3d9-4cb976e6a1f8 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:46.656788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9c5b20df-ff6f-4c1d-a3d9-4cb976e6a1f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:46.677698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b20df-ff6f-4c1d-a3d9-4cb976e6a1f8 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:46.723143 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1014/2071] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:46.738540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10530ff-9e0a-4510-9610-66af90a63492 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:46.810344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:46.821690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:46.823328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:46.824347 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:46.824737 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] PATH_INFO: `/v3/projects/4a2f407e90304e5e8599f82b66000cd4` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:46.827136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a2f407e90304e5e8599f82b66000cd4)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:46.830399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:46.893910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10530ff-9e0a-4510-9610-66af90a63492 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:46.904951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2f407e90304e5e8599f82b66000cd4', 'request_id': 'req-70f288df-eafa-4238-a051-8c5824cea0f0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:46.921143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2f407e90304e5e8599f82b66000cd4', 'request_id': 'req-70f288df-eafa-4238-a051-8c5824cea0f0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:46.932103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2f407e90304e5e8599f82b66000cd4', 'request_id': 'req-70f288df-eafa-4238-a051-8c5824cea0f0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:46.945287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] The token cache is being invalidate because project 4a2f407e90304e5e8599f82b66000cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:46.945788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:46.946454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:46.948625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1058/2072] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:46 2022] DELETE /identity/v3/projects/4a2f407e90304e5e8599f82b66000cd4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:46.952937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:46.954615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:46.964165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:47.001790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdff8cb-f7a7-47c7-a1a9-7d749d52043d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:47.004775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff8cb-f7a7-47c7-a1a9-7d749d52043d service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:47.006629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff8cb-f7a7-47c7-a1a9-7d749d52043d service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:47.006922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff8cb-f7a7-47c7-a1a9-7d749d52043d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:47.009928 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5bdff8cb-f7a7-47c7-a1a9-7d749d52043d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:47.096100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdff8cb-f7a7-47c7-a1a9-7d749d52043d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:47.105213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdff8cb-f7a7-47c7-a1a9-7d749d52043d service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:47.127279 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f288df-eafa-4238-a051-8c5824cea0f0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:47.131178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1015/2073] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:47.141950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:47.142871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:47.143158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:47.145552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] PATH_INFO: `/v3/users/8a984be45cfd423ba2b8cc90b609f854` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:47.147306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a984be45cfd423ba2b8cc90b609f854)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:47.149613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:47.272140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a984be45cfd423ba2b8cc90b609f854'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:47.285874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a984be45cfd423ba2b8cc90b609f854'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:47.287459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a984be45cfd423ba2b8cc90b609f854'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:47.308131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a984be45cfd423ba2b8cc90b609f854'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:47.345394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f703b65c-f6bf-4b89-8d9b-5172b84d442f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a984be45cfd423ba2b8cc90b609f854'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:47.357969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1059/2074] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:46 2022] DELETE /identity/v3/users/8a984be45cfd423ba2b8cc90b609f854 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:47.418878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30c1e-b1fd-47df-a913-fc12becae3cc None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:47.419542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30c1e-b1fd-47df-a913-fc12becae3cc None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:47.419863 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30c1e-b1fd-47df-a913-fc12becae3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:47.476939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1fc30c1e-b1fd-47df-a913-fc12becae3cc None None] MFA Rules not processed for user `2ff33d409a0a4b8c865e6a3b05abb456`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:47.479122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1fc30c1e-b1fd-47df-a913-fc12becae3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:47.663249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1016/2075] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:47.673670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54dfef-ef71-4529-b020-7a9e06069853 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:47.673996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54dfef-ef71-4529-b020-7a9e06069853 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:47.674228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54dfef-ef71-4529-b020-7a9e06069853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:47.703872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ae54dfef-ef71-4529-b020-7a9e06069853 None None] MFA Rules not processed for user `dbe443fb65c44907bdda10967fed340e`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:47.705235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ae54dfef-ef71-4529-b020-7a9e06069853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:47.834537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc30c1e-b1fd-47df-a913-fc12becae3cc None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:47.835617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1060/2076] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:47.843548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1fc30c1e-b1fd-47df-a913-fc12becae3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:47.881633 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54dfef-ef71-4529-b020-7a9e06069853 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:47.888470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ae54dfef-ef71-4529-b020-7a9e06069853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:47.920987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:47.982976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:48.022383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc30c1e-b1fd-47df-a913-fc12becae3cc None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.028274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.029255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.029690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.029935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] PATH_INFO: `/v3/projects/650477e839984679a85dc43620b4a520` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.031446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650477e839984679a85dc43620b4a520)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.033449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.061531 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54dfef-ef71-4529-b020-7a9e06069853 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.067772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd760bc-8167-443d-be65-557ac6d58856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.068442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd760bc-8167-443d-be65-557ac6d58856 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.068731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd760bc-8167-443d-be65-557ac6d58856 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.069012 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd760bc-8167-443d-be65-557ac6d58856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.071300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-afd760bc-8167-443d-be65-557ac6d58856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:48.085811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd760bc-8167-443d-be65-557ac6d58856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.088859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd760bc-8167-443d-be65-557ac6d58856 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.115069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1061/2077] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:48.129067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650477e839984679a85dc43620b4a520', 'request_id': 'req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:48.137036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650477e839984679a85dc43620b4a520', 'request_id': 'req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:48.151425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650477e839984679a85dc43620b4a520', 'request_id': 'req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:48.171546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] The token cache is being invalidate because project 650477e839984679a85dc43620b4a520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:48.171546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:48.172237 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-cb4d03b6-a637-4b0f-862b-aa8ebdde6b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:48.175486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1017/2078] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:47 2022] DELETE /identity/v3/projects/650477e839984679a85dc43620b4a520 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:48.180356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5932-05ca-4f32-b7e0-bc9d4ed18998 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.180837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5932-05ca-4f32-b7e0-bc9d4ed18998 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.181148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5932-05ca-4f32-b7e0-bc9d4ed18998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.208618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6dba5932-05ca-4f32-b7e0-bc9d4ed18998 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:48.210370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6dba5932-05ca-4f32-b7e0-bc9d4ed18998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:48.298517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1062/2079] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:48.307259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad829306-6576-4ad8-917f-9331c9d24407 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.308041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad829306-6576-4ad8-917f-9331c9d24407 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.308478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad829306-6576-4ad8-917f-9331c9d24407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.342053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-ad829306-6576-4ad8-917f-9331c9d24407 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:48.344162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ad829306-6576-4ad8-917f-9331c9d24407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:48.367956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1018/2080] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:48.373018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5932-05ca-4f32-b7e0-bc9d4ed18998 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.386336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5932-05ca-4f32-b7e0-bc9d4ed18998 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.396151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240050c-58af-476b-85fa-e82f8fdbe657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.397002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240050c-58af-476b-85fa-e82f8fdbe657 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.397393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240050c-58af-476b-85fa-e82f8fdbe657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.397774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240050c-58af-476b-85fa-e82f8fdbe657 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.401061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240050c-58af-476b-85fa-e82f8fdbe657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:48.401061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240050c-58af-476b-85fa-e82f8fdbe657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.403475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240050c-58af-476b-85fa-e82f8fdbe657 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.429950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1063/2081] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:48.434407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad829306-6576-4ad8-917f-9331c9d24407 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.450678 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad829306-6576-4ad8-917f-9331c9d24407 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.459310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a171f-f6c1-4c15-8971-0258d0d3df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.461320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a171f-f6c1-4c15-8971-0258d0d3df43 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.462005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a171f-f6c1-4c15-8971-0258d0d3df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.463019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a171f-f6c1-4c15-8971-0258d0d3df43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.464546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a171f-f6c1-4c15-8971-0258d0d3df43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.467761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a171f-f6c1-4c15-8971-0258d0d3df43 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.546910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1019/2082] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:48 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:48.551000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240050c-58af-476b-85fa-e82f8fdbe657 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.565877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240050c-58af-476b-85fa-e82f8fdbe657 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.655752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f6a26-ddf3-4d93-8183-e1eda29a7079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.656682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f6a26-ddf3-4d93-8183-e1eda29a7079 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.657100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f6a26-ddf3-4d93-8183-e1eda29a7079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.657611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f6a26-ddf3-4d93-8183-e1eda29a7079 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.659499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f6a26-ddf3-4d93-8183-e1eda29a7079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.663184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f6a26-ddf3-4d93-8183-e1eda29a7079 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.700292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1064/2083] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:48 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:48.705204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a171f-f6c1-4c15-8971-0258d0d3df43 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.732464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a171f-f6c1-4c15-8971-0258d0d3df43 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.763709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b5e0-8094-43cc-9adb-a0c63e56f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.763709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b5e0-8094-43cc-9adb-a0c63e56f400 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.763709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b5e0-8094-43cc-9adb-a0c63e56f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.763709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b5e0-8094-43cc-9adb-a0c63e56f400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.764149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4b5e0-8094-43cc-9adb-a0c63e56f400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.764149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4b5e0-8094-43cc-9adb-a0c63e56f400 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.810550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f6a26-ddf3-4d93-8183-e1eda29a7079 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.815800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1020/2084] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:48.829598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f6a26-ddf3-4d93-8183-e1eda29a7079 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.840709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089161f-6679-448e-a6b4-4630d63b4c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.842439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089161f-6679-448e-a6b4-4630d63b4c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.844019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089161f-6679-448e-a6b4-4630d63b4c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.844280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089161f-6679-448e-a6b4-4630d63b4c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.846273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089161f-6679-448e-a6b4-4630d63b4c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.850164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089161f-6679-448e-a6b4-4630d63b4c60 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.853585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b5e0-8094-43cc-9adb-a0c63e56f400 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.855369 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1de4b5e0-8094-43cc-9adb-a0c63e56f400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:48.876319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b5e0-8094-43cc-9adb-a0c63e56f400 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.877857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1065/2085] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:48.879014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089161f-6679-448e-a6b4-4630d63b4c60 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:48.897683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.898617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.900293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.902088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] PATH_INFO: `/v3/users/cbccb1a2bb6d43e1a39beda15872b776` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.908199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbccb1a2bb6d43e1a39beda15872b776)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.913310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.916024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089161f-6679-448e-a6b4-4630d63b4c60 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:48.929842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1687e1-16fd-4a99-afa9-d2021746e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:48.934310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1687e1-16fd-4a99-afa9-d2021746e8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:48.934716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1687e1-16fd-4a99-afa9-d2021746e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:48.935171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1687e1-16fd-4a99-afa9-d2021746e8fe admin admin] PATH_INFO: `/v3/projects/1c9e56411ed8494daf54da0c327e77c0/users/5d8fd1193b1d4f6497db47446ee3de3a/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:48.973690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1687e1-16fd-4a99-afa9-d2021746e8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9e56411ed8494daf54da0c327e77c0, user_id=5d8fd1193b1d4f6497db47446ee3de3a, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:48.980007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1687e1-16fd-4a99-afa9-d2021746e8fe admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:48.989738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:49.021119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1066/2086] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:48 2022] PUT /identity/v3/projects/1c9e56411ed8494daf54da0c327e77c0/users/5d8fd1193b1d4f6497db47446ee3de3a/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:49.023791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7c509-d991-4508-b142-c2f341760d7b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:49.024162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7c509-d991-4508-b142-c2f341760d7b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:49.024441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7c509-d991-4508-b142-c2f341760d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:49.045904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbccb1a2bb6d43e1a39beda15872b776'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:49.045904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbccb1a2bb6d43e1a39beda15872b776'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:49.058544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbccb1a2bb6d43e1a39beda15872b776'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:49.059777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbccb1a2bb6d43e1a39beda15872b776'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:49.080136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d2060642-f7a1-4ed9-8494-22e17829ab62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbccb1a2bb6d43e1a39beda15872b776'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:49.081734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:49.111660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1021/2087] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:48 2022] DELETE /identity/v3/users/cbccb1a2bb6d43e1a39beda15872b776 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:49.115981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb2c14-d900-48bc-abb7-ad7a12da93b0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:49.116386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb2c14-d900-48bc-abb7-ad7a12da93b0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:49.117210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb2c14-d900-48bc-abb7-ad7a12da93b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:49.131870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b4f7c509-d991-4508-b142-c2f341760d7b None None] MFA Rules not processed for user `5d8fd1193b1d4f6497db47446ee3de3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:49.135356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b4f7c509-d991-4508-b142-c2f341760d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:49.140573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-5beb2c14-d900-48bc-abb7-ad7a12da93b0 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:49.142806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5beb2c14-d900-48bc-abb7-ad7a12da93b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:49.245320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1022/2088] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:49.254744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb2c14-d900-48bc-abb7-ad7a12da93b0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:49.256823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5beb2c14-d900-48bc-abb7-ad7a12da93b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:49.269422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1067/2089] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:49.281953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7c509-d991-4508-b142-c2f341760d7b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:49.283756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b4f7c509-d991-4508-b142-c2f341760d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:49.364797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb2c14-d900-48bc-abb7-ad7a12da93b0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:49.373421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572490e-2484-4af4-a4ef-3925bb587c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:49.374142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572490e-2484-4af4-a4ef-3925bb587c16 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:49.374422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572490e-2484-4af4-a4ef-3925bb587c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:49.375254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572490e-2484-4af4-a4ef-3925bb587c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:49.386796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572490e-2484-4af4-a4ef-3925bb587c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:49.388339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572490e-2484-4af4-a4ef-3925bb587c16 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:49.392256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7c509-d991-4508-b142-c2f341760d7b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:49.401934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1023/2090] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:22:49.411117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90379a93-6280-4dac-b70e-fa07f4234391 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a418c5817e784d299c8d6daad20c6cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:49.411901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90379a93-6280-4dac-b70e-fa07f4234391 service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:49.412194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90379a93-6280-4dac-b70e-fa07f4234391 service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:49.412478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90379a93-6280-4dac-b70e-fa07f4234391 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:49.435629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90379a93-6280-4dac-b70e-fa07f4234391 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:49.437694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90379a93-6280-4dac-b70e-fa07f4234391 service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:49.452652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1068/2091] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:50.069272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572490e-2484-4af4-a4ef-3925bb587c16 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:50.071018 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6572490e-2484-4af4-a4ef-3925bb587c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:50.087441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572490e-2484-4af4-a4ef-3925bb587c16 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:50.102140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:50.103877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:50.104800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:50.105299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] PATH_INFO: `/v3/projects/2fba356b4d7b43bc836f1752312ecf6e` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:50.106728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fba356b4d7b43bc836f1752312ecf6e)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:50.109716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:50.217147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fba356b4d7b43bc836f1752312ecf6e', 'request_id': 'req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.227273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fba356b4d7b43bc836f1752312ecf6e', 'request_id': 'req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.245857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fba356b4d7b43bc836f1752312ecf6e', 'request_id': 'req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.266238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] The token cache is being invalidate because project 2fba356b4d7b43bc836f1752312ecf6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:50.266602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.267433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.269349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1024/2092] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:50 2022] DELETE /identity/v3/projects/2fba356b4d7b43bc836f1752312ecf6e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:50.276803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90379a93-6280-4dac-b70e-fa07f4234391 service glance] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:50.310329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90379a93-6280-4dac-b70e-fa07f4234391 service glance] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:50.504178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:50.506920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:50.507263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:50.507548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] PATH_INFO: `/v3/users/ff9f70845a7f40148f616c47a63f2c24` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:50.510335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9f70845a7f40148f616c47a63f2c24)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:50.512323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:50.594563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:50.611101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9f70845a7f40148f616c47a63f2c24'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.619939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9f70845a7f40148f616c47a63f2c24'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.621543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9f70845a7f40148f616c47a63f2c24'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.637480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9f70845a7f40148f616c47a63f2c24'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.681007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9f70845a7f40148f616c47a63f2c24'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:50.692353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1069/2093] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:50 2022] DELETE /identity/v3/users/ff9f70845a7f40148f616c47a63f2c24 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:51.608504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:51.612931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:51.628088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3fd67-5d94-4e79-b35e-aa81bb372cc6 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:51.632780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:51.755328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:51.756395 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:51.756679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:51.757798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] PATH_INFO: `/v3/projects/a1c50cf2771b46018bfc07a74352699a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:51.772122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c50cf2771b46018bfc07a74352699a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:51.773921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:51.858582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c50cf2771b46018bfc07a74352699a', 'request_id': 'req-9742b65b-22cd-4440-8946-4fa0aa518f13'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:51.866955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c50cf2771b46018bfc07a74352699a', 'request_id': 'req-9742b65b-22cd-4440-8946-4fa0aa518f13'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:51.882929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c50cf2771b46018bfc07a74352699a', 'request_id': 'req-9742b65b-22cd-4440-8946-4fa0aa518f13'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:51.907075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] The token cache is being invalidate because project a1c50cf2771b46018bfc07a74352699a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:51.907448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:51.912585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:51.914660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1025/2094] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:51 2022] DELETE /identity/v3/projects/a1c50cf2771b46018bfc07a74352699a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:51.918528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:51.920756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:51.942598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5f70-4392-4d53-ae06-5eafd59ff8f7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:52.030424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:52.031699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:52.032205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:52.032813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] PATH_INFO: `/v3/users/f6c93344f0bb4307ae41463f6cfd866c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:52.034359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c93344f0bb4307ae41463f6cfd866c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:52.036570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:52.124830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c93344f0bb4307ae41463f6cfd866c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:52.138757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c93344f0bb4307ae41463f6cfd866c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:52.141701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c93344f0bb4307ae41463f6cfd866c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:52.161672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c93344f0bb4307ae41463f6cfd866c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:52.195309 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c93344f0bb4307ae41463f6cfd866c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:52.210829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1070/2095] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:51 2022] DELETE /identity/v3/users/f6c93344f0bb4307ae41463f6cfd866c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:53.035184 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:53.037449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:53.104202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742b65b-22cd-4440-8946-4fa0aa518f13 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:53.267560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:53.271054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:53.271831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:53.272422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] PATH_INFO: `/v3/projects/c2650e74caf64d53ba592bdbe8f1e6c9` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:53.277665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2650e74caf64d53ba592bdbe8f1e6c9)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:53.280616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:53.407710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:53.436382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2650e74caf64d53ba592bdbe8f1e6c9', 'request_id': 'req-18f22bd1-f82d-4899-8650-a97ce60df891'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.449129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2650e74caf64d53ba592bdbe8f1e6c9', 'request_id': 'req-18f22bd1-f82d-4899-8650-a97ce60df891'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.449876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:53.452771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:53.461381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2650e74caf64d53ba592bdbe8f1e6c9', 'request_id': 'req-18f22bd1-f82d-4899-8650-a97ce60df891'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.479019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] The token cache is being invalidate because project c2650e74caf64d53ba592bdbe8f1e6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:53.479822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.480774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-18f22bd1-f82d-4899-8650-a97ce60df891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.483026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1026/2096] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:53 2022] DELETE /identity/v3/projects/c2650e74caf64d53ba592bdbe8f1e6c9 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:53.483554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30553017-f7ca-48cf-8b3d-644646d75f98 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:53.489161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f8eff-dff4-4d6c-afcc-10b58f9a2b52 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:53.489558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f8eff-dff4-4d6c-afcc-10b58f9a2b52 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:53.490107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f8eff-dff4-4d6c-afcc-10b58f9a2b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:53.527906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-006f8eff-dff4-4d6c-afcc-10b58f9a2b52 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:53.531993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-006f8eff-dff4-4d6c-afcc-10b58f9a2b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:53.559645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:53.659552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:53.660459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:53.660747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:53.661026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] PATH_INFO: `/v3/users/98170294307245099b8d760bf108beac` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:53.662745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98170294307245099b8d760bf108beac)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:53.674200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:53.713307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1027/2097] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:53.719617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ff9b8-e0dd-4e78-afbd-2e234d27776b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:53.719617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ff9b8-e0dd-4e78-afbd-2e234d27776b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:53.720078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ff9b8-e0dd-4e78-afbd-2e234d27776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:53.762525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-c86ff9b8-e0dd-4e78-afbd-2e234d27776b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:53.767054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c86ff9b8-e0dd-4e78-afbd-2e234d27776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:53.792149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1028/2098] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:53.793332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ff9b8-e0dd-4e78-afbd-2e234d27776b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:53.793478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98170294307245099b8d760bf108beac'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.804233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ff9b8-e0dd-4e78-afbd-2e234d27776b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:53.815839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98170294307245099b8d760bf108beac'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.817437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:53.818131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:53.818465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:53.818914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:53.820022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:53.820339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:53.822165 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:53.824823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98170294307245099b8d760bf108beac'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.836462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98170294307245099b8d760bf108beac'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.839470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1029/2099] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:53.843592 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:53.845891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:53.869614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-41aa992c-8c08-4be4-9538-51303fbe1af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98170294307245099b8d760bf108beac'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:53.872251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121e92-1f0c-4a09-b87d-c024bb8859fb admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:53.879186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874b622-f42f-4b3f-b488-e3369f78e376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:53.879973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874b622-f42f-4b3f-b488-e3369f78e376 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:53.880330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874b622-f42f-4b3f-b488-e3369f78e376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:53.887794 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874b622-f42f-4b3f-b488-e3369f78e376 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:53.889645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874b622-f42f-4b3f-b488-e3369f78e376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:53.891969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874b622-f42f-4b3f-b488-e3369f78e376 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:53.894305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1071/2100] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:53 2022] DELETE /identity/v3/users/98170294307245099b8d760bf108beac => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:53.898763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f124a-18d9-4e4d-8d3c-4134b66538b7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:53.899249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f124a-18d9-4e4d-8d3c-4134b66538b7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:53.900238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f124a-18d9-4e4d-8d3c-4134b66538b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:53.930172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c44f124a-18d9-4e4d-8d3c-4134b66538b7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:53.931866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c44f124a-18d9-4e4d-8d3c-4134b66538b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:53.967146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1030/2101] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:53 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:53.972512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874b622-f42f-4b3f-b488-e3369f78e376 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.081104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1072/2102] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:22:54.098008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874b622-f42f-4b3f-b488-e3369f78e376 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.107776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89873f3-283a-46aa-a7fd-f4d249498587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.108741 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89873f3-283a-46aa-a7fd-f4d249498587 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.110107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89873f3-283a-46aa-a7fd-f4d249498587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.110670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89873f3-283a-46aa-a7fd-f4d249498587 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.112108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89873f3-283a-46aa-a7fd-f4d249498587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.113791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f124a-18d9-4e4d-8d3c-4134b66538b7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.115162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c44f124a-18d9-4e4d-8d3c-4134b66538b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:54.116299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89873f3-283a-46aa-a7fd-f4d249498587 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.146029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1031/2103] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:53 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:54.151111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89873f3-283a-46aa-a7fd-f4d249498587 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.162855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89873f3-283a-46aa-a7fd-f4d249498587 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.171469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9f46-2365-4c34-a921-5ab5e35efecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.172164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9f46-2365-4c34-a921-5ab5e35efecb admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.172451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9f46-2365-4c34-a921-5ab5e35efecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.172727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df9f46-2365-4c34-a921-5ab5e35efecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.173944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df9f46-2365-4c34-a921-5ab5e35efecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.179100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df9f46-2365-4c34-a921-5ab5e35efecb admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.191840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1032/2104] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:54.197354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9f46-2365-4c34-a921-5ab5e35efecb admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.206551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:54.219504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df9f46-2365-4c34-a921-5ab5e35efecb admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.226510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d56b4d-33e7-48f7-b8ec-9538015a0efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.233158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d56b4d-33e7-48f7-b8ec-9538015a0efc admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.233942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d56b4d-33e7-48f7-b8ec-9538015a0efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.234187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d56b4d-33e7-48f7-b8ec-9538015a0efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.234861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d56b4d-33e7-48f7-b8ec-9538015a0efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.236700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d56b4d-33e7-48f7-b8ec-9538015a0efc admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.239456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:54.254936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1033/2105] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:54.260144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d56b4d-33e7-48f7-b8ec-9538015a0efc admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.263135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f124a-18d9-4e4d-8d3c-4134b66538b7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.300108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d56b4d-33e7-48f7-b8ec-9538015a0efc admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.305398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2013a-2397-4aa0-9d2f-068336bb0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.306343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2013a-2397-4aa0-9d2f-068336bb0225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.306628 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2013a-2397-4aa0-9d2f-068336bb0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.306906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2013a-2397-4aa0-9d2f-068336bb0225 admin admin] PATH_INFO: `/v3/projects/19158f1132924345851e1ef26462755a/users/45736d2ed19d481eb0404b98eee705ec/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.325397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2013a-2397-4aa0-9d2f-068336bb0225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19158f1132924345851e1ef26462755a, user_id=45736d2ed19d481eb0404b98eee705ec, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.333232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2013a-2397-4aa0-9d2f-068336bb0225 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.366870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9e917-873e-4375-b6e1-b986e38c7957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.367247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1034/2106] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:54 2022] PUT /identity/v3/projects/19158f1132924345851e1ef26462755a/users/45736d2ed19d481eb0404b98eee705ec/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:54.368050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9e917-873e-4375-b6e1-b986e38c7957 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.368377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9e917-873e-4375-b6e1-b986e38c7957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.368657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9e917-873e-4375-b6e1-b986e38c7957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.369696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf471424-e02d-4339-999e-fd231556ab71 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.370169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf471424-e02d-4339-999e-fd231556ab71 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.370678 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf471424-e02d-4339-999e-fd231556ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.382926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9e917-873e-4375-b6e1-b986e38c7957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.388741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9e917-873e-4375-b6e1-b986e38c7957 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.397552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1073/2107] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:22:54.405706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-bf471424-e02d-4339-999e-fd231556ab71 None None] MFA Rules not processed for user `45736d2ed19d481eb0404b98eee705ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:54.407064 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-bf471424-e02d-4339-999e-fd231556ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:54.490298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1035/2108] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:54.495301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9e917-873e-4375-b6e1-b986e38c7957 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.506068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9e917-873e-4375-b6e1-b986e38c7957 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.577807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d431-72b9-403b-85fd-19ae86d7c9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.578549 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d431-72b9-403b-85fd-19ae86d7c9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.578810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d431-72b9-403b-85fd-19ae86d7c9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.579453 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d431-72b9-403b-85fd-19ae86d7c9e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.583235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57d431-72b9-403b-85fd-19ae86d7c9e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.583235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57d431-72b9-403b-85fd-19ae86d7c9e1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.615776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1074/2109] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:54 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:54.620497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf471424-e02d-4339-999e-fd231556ab71 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.634171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf471424-e02d-4339-999e-fd231556ab71 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.740208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a85b-9981-4788-a21d-41aa0afce4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.741723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a85b-9981-4788-a21d-41aa0afce4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.742006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a85b-9981-4788-a21d-41aa0afce4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.742337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a85b-9981-4788-a21d-41aa0afce4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.743068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a85b-9981-4788-a21d-41aa0afce4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.745087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a85b-9981-4788-a21d-41aa0afce4f8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.779596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1036/2110] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:54 2022] POST /identity/v3/users => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:54.784190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d431-72b9-403b-85fd-19ae86d7c9e1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.803888 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d431-72b9-403b-85fd-19ae86d7c9e1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.815513 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26026875-c2c1-42d9-b14d-5b04f165bde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.816222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26026875-c2c1-42d9-b14d-5b04f165bde5 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.816508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26026875-c2c1-42d9-b14d-5b04f165bde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.816790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26026875-c2c1-42d9-b14d-5b04f165bde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.817529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26026875-c2c1-42d9-b14d-5b04f165bde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.819237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26026875-c2c1-42d9-b14d-5b04f165bde5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.850291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1075/2111] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:54.852051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a85b-9981-4788-a21d-41aa0afce4f8 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.868047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a85b-9981-4788-a21d-41aa0afce4f8 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:54.884161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01951d-5ed4-44d8-9b6b-5ed1d2fd2e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:54.885772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01951d-5ed4-44d8-9b6b-5ed1d2fd2e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:54.886063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01951d-5ed4-44d8-9b6b-5ed1d2fd2e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:54.888425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01951d-5ed4-44d8-9b6b-5ed1d2fd2e75 admin admin] PATH_INFO: `/v3/projects/fd3db81e7e044bd9b2e7ed4cfeeb71e1/users/1aba03c5f8594094ad13817883459a53/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:54.926507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01951d-5ed4-44d8-9b6b-5ed1d2fd2e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3db81e7e044bd9b2e7ed4cfeeb71e1, user_id=1aba03c5f8594094ad13817883459a53, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:54.931249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01951d-5ed4-44d8-9b6b-5ed1d2fd2e75 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:54.971942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1037/2112] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:54 2022] PUT /identity/v3/projects/fd3db81e7e044bd9b2e7ed4cfeeb71e1/users/1aba03c5f8594094ad13817883459a53/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:54.975933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26026875-c2c1-42d9-b14d-5b04f165bde5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:54.988542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26026875-c2c1-42d9-b14d-5b04f165bde5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:55.045308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba7563-ab57-45e4-8019-5d4ca68b5f79 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.045712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba7563-ab57-45e4-8019-5d4ca68b5f79 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.045948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba7563-ab57-45e4-8019-5d4ca68b5f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.101212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6aba7563-ab57-45e4-8019-5d4ca68b5f79 None None] MFA Rules not processed for user `05ba6d637a31453b88ba4c18b47697b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:55.104401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6aba7563-ab57-45e4-8019-5d4ca68b5f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:55.137541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:55.164932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33813079-ba1d-4165-85ce-e5b23db5a4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:55.166639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33813079-ba1d-4165-85ce-e5b23db5a4dc admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.166940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33813079-ba1d-4165-85ce-e5b23db5a4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.167385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33813079-ba1d-4165-85ce-e5b23db5a4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.168004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33813079-ba1d-4165-85ce-e5b23db5a4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:55.170918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33813079-ba1d-4165-85ce-e5b23db5a4dc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:55.189768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1076/2113] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:55.189768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33813079-ba1d-4165-85ce-e5b23db5a4dc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:55.191249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-33813079-ba1d-4165-85ce-e5b23db5a4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:55.211706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33813079-ba1d-4165-85ce-e5b23db5a4dc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:55.217606 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:55.218493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.218780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.223498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] PATH_INFO: `/v3/projects/b8d27cf7c3cc433e8571b951587cf510` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.228598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d27cf7c3cc433e8571b951587cf510)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:55.230931 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:55.247709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1038/2114] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:55.247709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba7563-ab57-45e4-8019-5d4ca68b5f79 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:55.257916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:55.269490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba7563-ab57-45e4-8019-5d4ca68b5f79 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:55.285971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f686313-1eb2-4944-8dd8-385e96d3ced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:55.286892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f686313-1eb2-4944-8dd8-385e96d3ced7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.287178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f686313-1eb2-4944-8dd8-385e96d3ced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.287488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f686313-1eb2-4944-8dd8-385e96d3ced7 admin admin] PATH_INFO: `/v3/projects/fd3db81e7e044bd9b2e7ed4cfeeb71e1/users/1aba03c5f8594094ad13817883459a53/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.291853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f686313-1eb2-4944-8dd8-385e96d3ced7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3db81e7e044bd9b2e7ed4cfeeb71e1, user_id=1aba03c5f8594094ad13817883459a53, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:55.294690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f686313-1eb2-4944-8dd8-385e96d3ced7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:55.317731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1039/2115] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:55 2022] PUT /identity/v3/projects/fd3db81e7e044bd9b2e7ed4cfeeb71e1/users/1aba03c5f8594094ad13817883459a53/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:55.318969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f686313-1eb2-4944-8dd8-385e96d3ced7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:55.335117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4f686313-1eb2-4944-8dd8-385e96d3ced7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:55.360300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d27cf7c3cc433e8571b951587cf510', 'request_id': 'req-0290565f-0153-4675-ae95-a490120fe4f3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:55.372510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d27cf7c3cc433e8571b951587cf510', 'request_id': 'req-0290565f-0153-4675-ae95-a490120fe4f3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:55.381557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d27cf7c3cc433e8571b951587cf510', 'request_id': 'req-0290565f-0153-4675-ae95-a490120fe4f3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:55.401010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] The token cache is being invalidate because project b8d27cf7c3cc433e8571b951587cf510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:22:55.401529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:55.402621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0290565f-0153-4675-ae95-a490120fe4f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:22:55.404942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1077/2116] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:22:55 2022] DELETE /identity/v3/projects/b8d27cf7c3cc433e8571b951587cf510 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:22:55.406610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29350c14-0ed0-43df-bcb2-e29140559524 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.408776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29350c14-0ed0-43df-bcb2-e29140559524 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.409226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29350c14-0ed0-43df-bcb2-e29140559524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.451736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-29350c14-0ed0-43df-bcb2-e29140559524 None None] MFA Rules not processed for user `1aba03c5f8594094ad13817883459a53`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:55.453392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-29350c14-0ed0-43df-bcb2-e29140559524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:55.463109 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f686313-1eb2-4944-8dd8-385e96d3ced7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:55.553630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1078/2117] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:55.558350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0a8d3-a281-498e-a74a-b933de47d3da None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.558350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0a8d3-a281-498e-a74a-b933de47d3da None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.558350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0a8d3-a281-498e-a74a-b933de47d3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.572150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3093f3-5362-4264-a84c-ca08ae7486f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:55.573113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3093f3-5362-4264-a84c-ca08ae7486f3 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.573560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3093f3-5362-4264-a84c-ca08ae7486f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.573999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3093f3-5362-4264-a84c-ca08ae7486f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.576120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3c3093f3-5362-4264-a84c-ca08ae7486f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:55.586572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b7b0a8d3-a281-498e-a74a-b933de47d3da None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:55.587976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b7b0a8d3-a281-498e-a74a-b933de47d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:55.623381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:55.656178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1079/2118] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:55.657124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0a8d3-a281-498e-a74a-b933de47d3da None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:55.658393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3093f3-5362-4264-a84c-ca08ae7486f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:55.658521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b7b0a8d3-a281-498e-a74a-b933de47d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:55.660269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3093f3-5362-4264-a84c-ca08ae7486f3 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:55.672575 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1040/2119] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:55.674101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269b046-9834-4d33-80a0-40b46d03008e None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.674389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269b046-9834-4d33-80a0-40b46d03008e None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.674798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269b046-9834-4d33-80a0-40b46d03008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.695820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8269b046-9834-4d33-80a0-40b46d03008e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:55.697909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8269b046-9834-4d33-80a0-40b46d03008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:55.705766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:55.709255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1041/2120] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:55.713299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269b046-9834-4d33-80a0-40b46d03008e None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:55.724236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269b046-9834-4d33-80a0-40b46d03008e None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:55.729414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfe67c-c0e7-4304-b7d9-77b28b9a58ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:55.730384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfe67c-c0e7-4304-b7d9-77b28b9a58ff admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.730843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfe67c-c0e7-4304-b7d9-77b28b9a58ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.731293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfe67c-c0e7-4304-b7d9-77b28b9a58ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.734787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfe67c-c0e7-4304-b7d9-77b28b9a58ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:22:55.734787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfe67c-c0e7-4304-b7d9-77b28b9a58ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:55.734787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfe67c-c0e7-4304-b7d9-77b28b9a58ff admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:55.739669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0a8d3-a281-498e-a74a-b933de47d3da None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:55.748682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c00180-5c1f-4524-b34e-de81fdfb0b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:55.749816 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00180-5c1f-4524-b34e-de81fdfb0b91 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.750119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00180-5c1f-4524-b34e-de81fdfb0b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.750244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1042/2121] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:22:55.750533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c00180-5c1f-4524-b34e-de81fdfb0b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.754381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfe67c-c0e7-4304-b7d9-77b28b9a58ff admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:55.762203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c00180-5c1f-4524-b34e-de81fdfb0b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:55.763697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c00180-5c1f-4524-b34e-de81fdfb0b91 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:55.770537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfe67c-c0e7-4304-b7d9-77b28b9a58ff admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:55.775542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435411c-5064-45e1-9637-42c0d03bfa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:55.776267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435411c-5064-45e1-9637-42c0d03bfa47 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.776615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435411c-5064-45e1-9637-42c0d03bfa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.776953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435411c-5064-45e1-9637-42c0d03bfa47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.777671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1080/2122] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:55.777785 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435411c-5064-45e1-9637-42c0d03bfa47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:55.780246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435411c-5064-45e1-9637-42c0d03bfa47 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:55.833617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1043/2123] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:22:55 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:22:55.838384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c00180-5c1f-4524-b34e-de81fdfb0b91 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:55.854025 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435411c-5064-45e1-9637-42c0d03bfa47 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:55.856077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c00180-5c1f-4524-b34e-de81fdfb0b91 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:55.856236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d435411c-5064-45e1-9637-42c0d03bfa47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:55.953005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f882fdf-5f79-4574-80b5-a8f05f957c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:55.955565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f882fdf-5f79-4574-80b5-a8f05f957c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.955701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f882fdf-5f79-4574-80b5-a8f05f957c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.955879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f882fdf-5f79-4574-80b5-a8f05f957c5e admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.957978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f882fdf-5f79-4574-80b5-a8f05f957c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:55.968441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f882fdf-5f79-4574-80b5-a8f05f957c5e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:55.972845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435411c-5064-45e1-9637-42c0d03bfa47 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:55.983593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208b992-0a5e-4310-96d0-6ef412262b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:55.984593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208b992-0a5e-4310-96d0-6ef412262b41 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:55.984970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208b992-0a5e-4310-96d0-6ef412262b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:55.985491 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208b992-0a5e-4310-96d0-6ef412262b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:55.991308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6208b992-0a5e-4310-96d0-6ef412262b41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:56.037942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1081/2124] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:22:55 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:22:56.039602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f882fdf-5f79-4574-80b5-a8f05f957c5e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:56.057393 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f882fdf-5f79-4574-80b5-a8f05f957c5e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:56.063865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2be5ee-c886-4e59-b4df-6009d26e727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:56.064530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be5ee-c886-4e59-b4df-6009d26e727f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:56.064810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be5ee-c886-4e59-b4df-6009d26e727f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:56.065083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2be5ee-c886-4e59-b4df-6009d26e727f admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:56.065909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2be5ee-c886-4e59-b4df-6009d26e727f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:56.067414 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2be5ee-c886-4e59-b4df-6009d26e727f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:56.082182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1082/2125] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:22:56.083080 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2be5ee-c886-4e59-b4df-6009d26e727f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:56.095435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2be5ee-c886-4e59-b4df-6009d26e727f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:56.103257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874f364-0cc2-4197-be8e-c978dc322924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:56.104088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874f364-0cc2-4197-be8e-c978dc322924 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:56.104491 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874f364-0cc2-4197-be8e-c978dc322924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:56.104852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874f364-0cc2-4197-be8e-c978dc322924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:56.105665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874f364-0cc2-4197-be8e-c978dc322924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:56.107270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874f364-0cc2-4197-be8e-c978dc322924 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:56.112382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208b992-0a5e-4310-96d0-6ef412262b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:56.114230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208b992-0a5e-4310-96d0-6ef412262b41 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:56.119836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1083/2126] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:22:56.123929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874f364-0cc2-4197-be8e-c978dc322924 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:56.134511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874f364-0cc2-4197-be8e-c978dc322924 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:56.139368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1044/2127] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:56.142090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e9cd-0252-4d30-bcf0-50a18b9dfde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:56.143807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e9cd-0252-4d30-bcf0-50a18b9dfde4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:56.144293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e9cd-0252-4d30-bcf0-50a18b9dfde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:56.144711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9e9cd-0252-4d30-bcf0-50a18b9dfde4 admin admin] PATH_INFO: `/v3/projects/a7d59515ba11404880ba037bdaa56b0d/users/97f29cd4bbeb47f0bc8a7e6110245aeb/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:56.193926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e9cd-0252-4d30-bcf0-50a18b9dfde4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d59515ba11404880ba037bdaa56b0d, user_id=97f29cd4bbeb47f0bc8a7e6110245aeb, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:56.197822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9e9cd-0252-4d30-bcf0-50a18b9dfde4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:56.224716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1084/2128] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:22:56 2022] PUT /identity/v3/projects/a7d59515ba11404880ba037bdaa56b0d/users/97f29cd4bbeb47f0bc8a7e6110245aeb/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:22:56.236699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d586e-97a7-4bde-aff0-1befba3ef917 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:56.237144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d586e-97a7-4bde-aff0-1befba3ef917 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:56.237526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d586e-97a7-4bde-aff0-1befba3ef917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:56.270752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-523d586e-97a7-4bde-aff0-1befba3ef917 None None] MFA Rules not processed for user `97f29cd4bbeb47f0bc8a7e6110245aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:56.272289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-523d586e-97a7-4bde-aff0-1befba3ef917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:56.330839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:22:56.379443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1045/2129] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:56.389789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e9cd-0252-4d30-bcf0-50a18b9dfde4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:56.395579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-20a9e9cd-0252-4d30-bcf0-50a18b9dfde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:56.471522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9e9cd-0252-4d30-bcf0-50a18b9dfde4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:22:56.476048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b319be-a010-4bec-b697-8d1e077a2484 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a418c5817e784d299c8d6daad20c6cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:22:56.476796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b319be-a010-4bec-b697-8d1e077a2484 service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:56.478702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b319be-a010-4bec-b697-8d1e077a2484 service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:56.479099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b319be-a010-4bec-b697-8d1e077a2484 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:56.500241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b319be-a010-4bec-b697-8d1e077a2484 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:22:56.502465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b319be-a010-4bec-b697-8d1e077a2484 service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:22:56.516317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1085/2130] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:22:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:22:57.778981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2781-ba21-48ea-a6c3-ebef164fb67b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:22:57.779527 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2781-ba21-48ea-a6c3-ebef164fb67b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:22:57.779635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2781-ba21-48ea-a6c3-ebef164fb67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:22:57.810744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-749c2781-ba21-48ea-a6c3-ebef164fb67b None None] MFA Rules not processed for user `05ba6d637a31453b88ba4c18b47697b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:22:57.812783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-749c2781-ba21-48ea-a6c3-ebef164fb67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:57.903505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1046/2131] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:22:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:22:59.956584 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b319be-a010-4bec-b697-8d1e077a2484 service glance] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:22:59.957994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-20b319be-a010-4bec-b697-8d1e077a2484 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:22:59.973566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:00.025695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b319be-a010-4bec-b697-8d1e077a2484 service glance] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:00.030505 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:00.031561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:00.031849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:00.032185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] PATH_INFO: `/v3/users/45736d2ed19d481eb0404b98eee705ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:00.033618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=45736d2ed19d481eb0404b98eee705ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:00.035647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:00.082753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45736d2ed19d481eb0404b98eee705ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.090249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45736d2ed19d481eb0404b98eee705ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.090926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45736d2ed19d481eb0404b98eee705ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.098657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45736d2ed19d481eb0404b98eee705ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.112123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45736d2ed19d481eb0404b98eee705ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.118192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1086/2132] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:22:59 2022] DELETE /identity/v3/users/45736d2ed19d481eb0404b98eee705ec => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:23:00.122830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9005-7dee-45b0-8dca-6744b6a405d0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:00.123312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9005-7dee-45b0-8dca-6744b6a405d0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:00.123459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9005-7dee-45b0-8dca-6744b6a405d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:00.141355 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1d9a9005-7dee-45b0-8dca-6744b6a405d0 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:00.142593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1d9a9005-7dee-45b0-8dca-6744b6a405d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:00.201387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1047/2133] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:00.211178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:00.213172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:00.276524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145ec6e-0fb6-4e13-aba6-09caec789c9b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:00.280307 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292e06c-e7b6-4393-a543-51df0add8fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:00.288126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292e06c-e7b6-4393-a543-51df0add8fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:00.288126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292e06c-e7b6-4393-a543-51df0add8fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:00.288126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292e06c-e7b6-4393-a543-51df0add8fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:00.295764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292e06c-e7b6-4393-a543-51df0add8fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:00.297197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292e06c-e7b6-4393-a543-51df0add8fc6 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:00.306981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1087/2134] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:00.684398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9005-7dee-45b0-8dca-6744b6a405d0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:00.686015 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1d9a9005-7dee-45b0-8dca-6744b6a405d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:00.705765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9005-7dee-45b0-8dca-6744b6a405d0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:00.711845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:00.713032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:00.713387 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:00.713742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] PATH_INFO: `/v3/projects/19158f1132924345851e1ef26462755a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:00.715689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19158f1132924345851e1ef26462755a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:00.717827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:00.777252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19158f1132924345851e1ef26462755a', 'request_id': 'req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.796124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19158f1132924345851e1ef26462755a', 'request_id': 'req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.804487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19158f1132924345851e1ef26462755a', 'request_id': 'req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.817895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] The token cache is being invalidate because project 19158f1132924345851e1ef26462755a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:00.818235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.818944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.821737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1048/2135] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:00 2022] DELETE /identity/v3/projects/19158f1132924345851e1ef26462755a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:00.825527 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292e06c-e7b6-4393-a543-51df0add8fc6 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:00.835956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292e06c-e7b6-4393-a543-51df0add8fc6 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:00.869675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:00.900409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:00.901294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:00.901582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:00.901867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] PATH_INFO: `/v3/users/1aba03c5f8594094ad13817883459a53` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:00.903079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aba03c5f8594094ad13817883459a53)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:00.905143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:00.959146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aba03c5f8594094ad13817883459a53'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.966052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aba03c5f8594094ad13817883459a53'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.966713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aba03c5f8594094ad13817883459a53'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.973525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aba03c5f8594094ad13817883459a53'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.990258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6918ee4b-2e1d-46d7-9e51-03dd9de2f717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aba03c5f8594094ad13817883459a53'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:00.998284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1088/2136] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:00 2022] DELETE /identity/v3/users/1aba03c5f8594094ad13817883459a53 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:01.273089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:01.275204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:01.290284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79a6fc-c80a-4bb1-8686-041d510e6cb4 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:01.296200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:01.377886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:01.378760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.379072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.379367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] PATH_INFO: `/v3/projects/fd3db81e7e044bd9b2e7ed4cfeeb71e1` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.380601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd3db81e7e044bd9b2e7ed4cfeeb71e1)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:01.382493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:01.428715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3db81e7e044bd9b2e7ed4cfeeb71e1', 'request_id': 'req-04e11184-b67d-420d-bb35-dfc816dd525a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:01.435752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3db81e7e044bd9b2e7ed4cfeeb71e1', 'request_id': 'req-04e11184-b67d-420d-bb35-dfc816dd525a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:01.443311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3db81e7e044bd9b2e7ed4cfeeb71e1', 'request_id': 'req-04e11184-b67d-420d-bb35-dfc816dd525a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:01.454772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] The token cache is being invalidate because project fd3db81e7e044bd9b2e7ed4cfeeb71e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:01.455085 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:01.455797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-04e11184-b67d-420d-bb35-dfc816dd525a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:01.457372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1049/2137] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:01 2022] DELETE /identity/v3/projects/fd3db81e7e044bd9b2e7ed4cfeeb71e1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:23:01.462861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36977c62-a828-4ea3-af15-939ee2a94ee2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.463154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36977c62-a828-4ea3-af15-939ee2a94ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.463475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36977c62-a828-4ea3-af15-939ee2a94ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.482010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-36977c62-a828-4ea3-af15-939ee2a94ee2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:01.483212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-36977c62-a828-4ea3-af15-939ee2a94ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:01.545137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1089/2138] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:01.553790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51578080-1dc6-41d0-9506-6425640d28b8 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.554096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51578080-1dc6-41d0-9506-6425640d28b8 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.554410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51578080-1dc6-41d0-9506-6425640d28b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.573042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-51578080-1dc6-41d0-9506-6425640d28b8 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:01.574373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-51578080-1dc6-41d0-9506-6425640d28b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:01.583118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1050/2139] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:01.587964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36977c62-a828-4ea3-af15-939ee2a94ee2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:01.597608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36977c62-a828-4ea3-af15-939ee2a94ee2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:01.602149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fc37-c2d1-4014-a740-73e59a82c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:01.603360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fc37-c2d1-4014-a740-73e59a82c1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.603695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fc37-c2d1-4014-a740-73e59a82c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.604001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fc37-c2d1-4014-a740-73e59a82c1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.604736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fc37-c2d1-4014-a740-73e59a82c1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:01.605050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fc37-c2d1-4014-a740-73e59a82c1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:01.606643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fc37-c2d1-4014-a740-73e59a82c1f6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:01.622566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1090/2140] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:01.623853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51578080-1dc6-41d0-9506-6425640d28b8 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:01.634091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51578080-1dc6-41d0-9506-6425640d28b8 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:01.640005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183fb2f-3a07-40d1-9c42-b88921016019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:01.640798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183fb2f-3a07-40d1-9c42-b88921016019 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.641151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183fb2f-3a07-40d1-9c42-b88921016019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.641506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183fb2f-3a07-40d1-9c42-b88921016019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.642283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183fb2f-3a07-40d1-9c42-b88921016019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:01.644344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183fb2f-3a07-40d1-9c42-b88921016019 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:01.676642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1051/2141] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:01 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:01.677832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fc37-c2d1-4014-a740-73e59a82c1f6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:01.687921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fc37-c2d1-4014-a740-73e59a82c1f6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:01.729527 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:01.750184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f738d5-6a77-4fae-9ce4-3f6a007cad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:01.750871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f738d5-6a77-4fae-9ce4-3f6a007cad9a admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.751159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f738d5-6a77-4fae-9ce4-3f6a007cad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.751481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f738d5-6a77-4fae-9ce4-3f6a007cad9a admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.752187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f738d5-6a77-4fae-9ce4-3f6a007cad9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:01.754133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f738d5-6a77-4fae-9ce4-3f6a007cad9a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:01.775330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1091/2142] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:01 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:01.779520 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183fb2f-3a07-40d1-9c42-b88921016019 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:01.789950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183fb2f-3a07-40d1-9c42-b88921016019 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:01.794595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcf1e1-c799-48ad-a13f-28efa3c25d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:01.795250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcf1e1-c799-48ad-a13f-28efa3c25d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.795565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcf1e1-c799-48ad-a13f-28efa3c25d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.795840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcf1e1-c799-48ad-a13f-28efa3c25d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.796577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcf1e1-c799-48ad-a13f-28efa3c25d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:01.798147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcf1e1-c799-48ad-a13f-28efa3c25d55 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:01.808564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1052/2143] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:01.812577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f738d5-6a77-4fae-9ce4-3f6a007cad9a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:01.823320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f738d5-6a77-4fae-9ce4-3f6a007cad9a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:01.828000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc00d9d-25da-45b3-82f7-877121038f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:01.828662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00d9d-25da-45b3-82f7-877121038f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.828948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00d9d-25da-45b3-82f7-877121038f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.829230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc00d9d-25da-45b3-82f7-877121038f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.829987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc00d9d-25da-45b3-82f7-877121038f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:01.831600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc00d9d-25da-45b3-82f7-877121038f4b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:01.844028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1092/2144] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:01.848874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcf1e1-c799-48ad-a13f-28efa3c25d55 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:01.859270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcf1e1-c799-48ad-a13f-28efa3c25d55 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:01.863990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb25056-8faa-4fd8-87a6-a786cdc3e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:01.864914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25056-8faa-4fd8-87a6-a786cdc3e768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.865201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25056-8faa-4fd8-87a6-a786cdc3e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.865476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25056-8faa-4fd8-87a6-a786cdc3e768 admin admin] PATH_INFO: `/v3/projects/b10ccfbe6b8745439fc1ed0ede969525/users/545c6f380ce64ac6837e5928e6035576/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.880209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb25056-8faa-4fd8-87a6-a786cdc3e768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10ccfbe6b8745439fc1ed0ede969525, user_id=545c6f380ce64ac6837e5928e6035576, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:01.882837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb25056-8faa-4fd8-87a6-a786cdc3e768 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:01.896209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1053/2145] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:01 2022] PUT /identity/v3/projects/b10ccfbe6b8745439fc1ed0ede969525/users/545c6f380ce64ac6837e5928e6035576/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:01.907066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4d655-83b2-48ca-820f-3dd5f9a69b06 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:01.907399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4d655-83b2-48ca-820f-3dd5f9a69b06 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:01.907687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4d655-83b2-48ca-820f-3dd5f9a69b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:01.935026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ccb4d655-83b2-48ca-820f-3dd5f9a69b06 None None] MFA Rules not processed for user `545c6f380ce64ac6837e5928e6035576`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:01.936467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ccb4d655-83b2-48ca-820f-3dd5f9a69b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:02.005675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1093/2146] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:02.010741 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb25056-8faa-4fd8-87a6-a786cdc3e768 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.046502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:02.079282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb25056-8faa-4fd8-87a6-a786cdc3e768 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.084904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631c6a4-731b-4911-a4a6-1c8edb93692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.085793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631c6a4-731b-4911-a4a6-1c8edb93692c admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.086291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631c6a4-731b-4911-a4a6-1c8edb93692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.086679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631c6a4-731b-4911-a4a6-1c8edb93692c admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.088289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631c6a4-731b-4911-a4a6-1c8edb93692c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.090421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631c6a4-731b-4911-a4a6-1c8edb93692c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.117336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1054/2147] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:02 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:02.121678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4d655-83b2-48ca-820f-3dd5f9a69b06 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.132747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4d655-83b2-48ca-820f-3dd5f9a69b06 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.192770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775bcb8-64c5-4991-bc0f-e3b0f52d0e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.193446 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775bcb8-64c5-4991-bc0f-e3b0f52d0e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.193730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775bcb8-64c5-4991-bc0f-e3b0f52d0e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.194007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775bcb8-64c5-4991-bc0f-e3b0f52d0e00 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.194994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775bcb8-64c5-4991-bc0f-e3b0f52d0e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.197617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775bcb8-64c5-4991-bc0f-e3b0f52d0e00 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.220502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1094/2148] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:02 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:02.221929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631c6a4-731b-4911-a4a6-1c8edb93692c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.232234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631c6a4-731b-4911-a4a6-1c8edb93692c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.237644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3c3d8-dcc6-43e1-899c-9abc0a7f40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.238505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3c3d8-dcc6-43e1-899c-9abc0a7f40cd admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.238876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3c3d8-dcc6-43e1-899c-9abc0a7f40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.239156 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3c3d8-dcc6-43e1-899c-9abc0a7f40cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.239935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3c3d8-dcc6-43e1-899c-9abc0a7f40cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.241543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3c3d8-dcc6-43e1-899c-9abc0a7f40cd admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.253627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1055/2149] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:02.257795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775bcb8-64c5-4991-bc0f-e3b0f52d0e00 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.268466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775bcb8-64c5-4991-bc0f-e3b0f52d0e00 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.273117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357a114-aa80-4ce8-b279-ceefdf939f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.273997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357a114-aa80-4ce8-b279-ceefdf939f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.274281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357a114-aa80-4ce8-b279-ceefdf939f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.274558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357a114-aa80-4ce8-b279-ceefdf939f30 admin admin] PATH_INFO: `/v3/projects/f39fb15da3b948f2b4344dc5e2323d1e/users/5ecd7f355bd64427817480c2233e5a38/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.289259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357a114-aa80-4ce8-b279-ceefdf939f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39fb15da3b948f2b4344dc5e2323d1e, user_id=5ecd7f355bd64427817480c2233e5a38, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.291956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357a114-aa80-4ce8-b279-ceefdf939f30 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.304842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1095/2150] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:02 2022] PUT /identity/v3/projects/f39fb15da3b948f2b4344dc5e2323d1e/users/5ecd7f355bd64427817480c2233e5a38/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:02.309334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3c3d8-dcc6-43e1-899c-9abc0a7f40cd admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.319835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3c3d8-dcc6-43e1-899c-9abc0a7f40cd admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.385456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dab4d-f90f-411a-a6c8-5e1f517550b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.386274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dab4d-f90f-411a-a6c8-5e1f517550b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.386662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dab4d-f90f-411a-a6c8-5e1f517550b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.387074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dab4d-f90f-411a-a6c8-5e1f517550b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.388043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dab4d-f90f-411a-a6c8-5e1f517550b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.389919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dab4d-f90f-411a-a6c8-5e1f517550b6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.404742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1056/2151] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:02.408289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357a114-aa80-4ce8-b279-ceefdf939f30 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.418566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357a114-aa80-4ce8-b279-ceefdf939f30 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.423508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93f648-6b2e-4541-a2a4-cb8fb641dd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.424386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93f648-6b2e-4541-a2a4-cb8fb641dd51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.424667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93f648-6b2e-4541-a2a4-cb8fb641dd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.424941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93f648-6b2e-4541-a2a4-cb8fb641dd51 admin admin] PATH_INFO: `/v3/projects/f39fb15da3b948f2b4344dc5e2323d1e/users/5ecd7f355bd64427817480c2233e5a38/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.426919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93f648-6b2e-4541-a2a4-cb8fb641dd51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39fb15da3b948f2b4344dc5e2323d1e, user_id=5ecd7f355bd64427817480c2233e5a38, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.429576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93f648-6b2e-4541-a2a4-cb8fb641dd51 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.441110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1096/2152] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:02 2022] PUT /identity/v3/projects/f39fb15da3b948f2b4344dc5e2323d1e/users/5ecd7f355bd64427817480c2233e5a38/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:02.452065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c9455-27ef-44d5-affa-6468502e2c4a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.452451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c9455-27ef-44d5-affa-6468502e2c4a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.452743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c9455-27ef-44d5-affa-6468502e2c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.489747 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-320c9455-27ef-44d5-affa-6468502e2c4a None None] MFA Rules not processed for user `5ecd7f355bd64427817480c2233e5a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:02.491124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-320c9455-27ef-44d5-affa-6468502e2c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:02.564441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1057/2153] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:02.575536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93f648-6b2e-4541-a2a4-cb8fb641dd51 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.577252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2a93f648-6b2e-4541-a2a4-cb8fb641dd51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:02.582745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:02.637772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93f648-6b2e-4541-a2a4-cb8fb641dd51 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.641333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fca6f-bbf7-449f-8a0f-5f7066c33977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.641980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fca6f-bbf7-449f-8a0f-5f7066c33977 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.642266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fca6f-bbf7-449f-8a0f-5f7066c33977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.642541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fca6f-bbf7-449f-8a0f-5f7066c33977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.651478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fca6f-bbf7-449f-8a0f-5f7066c33977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.652887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fca6f-bbf7-449f-8a0f-5f7066c33977 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.662358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1097/2154] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:02.764780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c9455-27ef-44d5-affa-6468502e2c4a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:02.774401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c9455-27ef-44d5-affa-6468502e2c4a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:02.778076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced84d-2537-41a2-a7a8-f5b91649fb38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:02.778734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced84d-2537-41a2-a7a8-f5b91649fb38 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:02.779024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced84d-2537-41a2-a7a8-f5b91649fb38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:02.779305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ced84d-2537-41a2-a7a8-f5b91649fb38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:02.809418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:02.843406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ced84d-2537-41a2-a7a8-f5b91649fb38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:02.844927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ced84d-2537-41a2-a7a8-f5b91649fb38 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:02.855389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1058/2155] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:04.974020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fca6f-bbf7-449f-8a0f-5f7066c33977 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:04.983140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fca6f-bbf7-449f-8a0f-5f7066c33977 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:04.986861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95626a1-99a8-4fa1-9c12-7167a3a9bc60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:04.987534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95626a1-99a8-4fa1-9c12-7167a3a9bc60 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:04.987818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95626a1-99a8-4fa1-9c12-7167a3a9bc60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:04.988094 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95626a1-99a8-4fa1-9c12-7167a3a9bc60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:04.989861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c95626a1-99a8-4fa1-9c12-7167a3a9bc60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:05.055060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95626a1-99a8-4fa1-9c12-7167a3a9bc60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:05.057182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95626a1-99a8-4fa1-9c12-7167a3a9bc60 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:05.066576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1098/2156] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:05.430710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced84d-2537-41a2-a7a8-f5b91649fb38 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:05.510219 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ced84d-2537-41a2-a7a8-f5b91649fb38 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:05.514883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:05.515835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:05.516122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:05.516408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] PATH_INFO: `/v3/users/545c6f380ce64ac6837e5928e6035576` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:05.517653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545c6f380ce64ac6837e5928e6035576)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:05.519625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:05.592786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545c6f380ce64ac6837e5928e6035576'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:05.593435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545c6f380ce64ac6837e5928e6035576'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:05.602076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545c6f380ce64ac6837e5928e6035576'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:05.602657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545c6f380ce64ac6837e5928e6035576'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:05.611943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545c6f380ce64ac6837e5928e6035576'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:05.641251 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1059/2157] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:05 2022] DELETE /identity/v3/users/545c6f380ce64ac6837e5928e6035576 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:05.641361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9d007-c4cb-4d30-a0c5-153cadfd4e9b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:05.641361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9d007-c4cb-4d30-a0c5-153cadfd4e9b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:05.641361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9d007-c4cb-4d30-a0c5-153cadfd4e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:05.659750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-92a9d007-c4cb-4d30-a0c5-153cadfd4e9b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:05.660903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-92a9d007-c4cb-4d30-a0c5-153cadfd4e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:05.723226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1099/2158] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:05.732786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:05.734257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:05.793490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:05.799957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94742446-a030-4ccf-ad91-59db0787a1d9 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:05.807152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2f65f-87b0-4d72-a1c5-b9d56c8c6482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:05.807845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f65f-87b0-4d72-a1c5-b9d56c8c6482 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:05.808124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f65f-87b0-4d72-a1c5-b9d56c8c6482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:05.808397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2f65f-87b0-4d72-a1c5-b9d56c8c6482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:05.820068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2f65f-87b0-4d72-a1c5-b9d56c8c6482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:05.822047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2f65f-87b0-4d72-a1c5-b9d56c8c6482 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:05.832349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1060/2159] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:06.189243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9d007-c4cb-4d30-a0c5-153cadfd4e9b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:06.190889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-92a9d007-c4cb-4d30-a0c5-153cadfd4e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:06.204688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9d007-c4cb-4d30-a0c5-153cadfd4e9b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:06.209301 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:06.210163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:06.210443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:06.210713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] PATH_INFO: `/v3/projects/b10ccfbe6b8745439fc1ed0ede969525` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:06.212037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10ccfbe6b8745439fc1ed0ede969525)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:06.213933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:06.251228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:06.265963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10ccfbe6b8745439fc1ed0ede969525', 'request_id': 'req-b3488513-b6a6-48b3-ae03-a888d5043649'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.283857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10ccfbe6b8745439fc1ed0ede969525', 'request_id': 'req-b3488513-b6a6-48b3-ae03-a888d5043649'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.290697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10ccfbe6b8745439fc1ed0ede969525', 'request_id': 'req-b3488513-b6a6-48b3-ae03-a888d5043649'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.302617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] The token cache is being invalidate because project b10ccfbe6b8745439fc1ed0ede969525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:06.302935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.303901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.306106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1100/2160] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:06 2022] DELETE /identity/v3/projects/b10ccfbe6b8745439fc1ed0ede969525 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:06.309942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2f65f-87b0-4d72-a1c5-b9d56c8c6482 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:06.328356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2f65f-87b0-4d72-a1c5-b9d56c8c6482 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:06.403635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:06.404515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:06.404799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:06.405079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] PATH_INFO: `/v3/users/5ecd7f355bd64427817480c2233e5a38` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:06.406333 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ecd7f355bd64427817480c2233e5a38)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:06.408379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:06.475001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ecd7f355bd64427817480c2233e5a38'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.475658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ecd7f355bd64427817480c2233e5a38'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.486600 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ecd7f355bd64427817480c2233e5a38'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.487508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ecd7f355bd64427817480c2233e5a38'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.499070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c3fd0b2f-f88a-45a8-b5d9-3d4b4d59bd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ecd7f355bd64427817480c2233e5a38'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.517263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1061/2161] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:06 2022] DELETE /identity/v3/users/5ecd7f355bd64427817480c2233e5a38 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:06.818703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:06.820400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:06.834673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3488513-b6a6-48b3-ae03-a888d5043649 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:06.920627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:06.921573 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:06.921830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:06.922111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] PATH_INFO: `/v3/projects/f39fb15da3b948f2b4344dc5e2323d1e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:06.923322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39fb15da3b948f2b4344dc5e2323d1e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:06.925274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:06.985752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39fb15da3b948f2b4344dc5e2323d1e', 'request_id': 'req-ed9ea989-5032-4241-820a-2bbd096af00b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:06.993988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39fb15da3b948f2b4344dc5e2323d1e', 'request_id': 'req-ed9ea989-5032-4241-820a-2bbd096af00b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:07.001071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39fb15da3b948f2b4344dc5e2323d1e', 'request_id': 'req-ed9ea989-5032-4241-820a-2bbd096af00b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:07.012970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] The token cache is being invalidate because project f39fb15da3b948f2b4344dc5e2323d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:07.013259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:07.013985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed9ea989-5032-4241-820a-2bbd096af00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:07.015890 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1101/2162] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:06 2022] DELETE /identity/v3/projects/f39fb15da3b948f2b4344dc5e2323d1e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:07.020882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698cbf1-5d33-4e41-9ebd-c627558bd9de None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.021290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698cbf1-5d33-4e41-9ebd-c627558bd9de None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.021661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698cbf1-5d33-4e41-9ebd-c627558bd9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.046032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-3698cbf1-5d33-4e41-9ebd-c627558bd9de None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:07.047416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3698cbf1-5d33-4e41-9ebd-c627558bd9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:07.130582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1062/2163] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:07.138228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27d6f0-0ac6-4b73-81ca-71c83bae3585 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.138594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27d6f0-0ac6-4b73-81ca-71c83bae3585 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.138883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27d6f0-0ac6-4b73-81ca-71c83bae3585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.164612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9a27d6f0-0ac6-4b73-81ca-71c83bae3585 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:07.166467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9a27d6f0-0ac6-4b73-81ca-71c83bae3585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:07.185501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1102/2164] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:07.189872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698cbf1-5d33-4e41-9ebd-c627558bd9de None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:07.200396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698cbf1-5d33-4e41-9ebd-c627558bd9de None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:07.205265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c6980-e09b-4d1a-a809-1bd61b70e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:07.205752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c6980-e09b-4d1a-a809-1bd61b70e0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.206035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c6980-e09b-4d1a-a809-1bd61b70e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.206307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c6980-e09b-4d1a-a809-1bd61b70e0b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.207043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c6980-e09b-4d1a-a809-1bd61b70e0b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:07.207367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c6980-e09b-4d1a-a809-1bd61b70e0b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:07.209040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c6980-e09b-4d1a-a809-1bd61b70e0b7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:07.212819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:07.229379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27d6f0-0ac6-4b73-81ca-71c83bae3585 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:07.235897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1063/2165] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:07.240380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27d6f0-0ac6-4b73-81ca-71c83bae3585 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:07.246092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782025-808a-4ed0-b75d-78408e4dfcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:07.247329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782025-808a-4ed0-b75d-78408e4dfcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.247680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782025-808a-4ed0-b75d-78408e4dfcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.247959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782025-808a-4ed0-b75d-78408e4dfcf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.248653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a782025-808a-4ed0-b75d-78408e4dfcf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:07.250616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a782025-808a-4ed0-b75d-78408e4dfcf7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:07.276936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1103/2166] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:07 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:07.280964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c6980-e09b-4d1a-a809-1bd61b70e0b7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:07.291361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c6980-e09b-4d1a-a809-1bd61b70e0b7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:07.353575 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff97b91-6491-4d3b-a5e4-6f9ab49849e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:07.354281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff97b91-6491-4d3b-a5e4-6f9ab49849e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.354567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff97b91-6491-4d3b-a5e4-6f9ab49849e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.354862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff97b91-6491-4d3b-a5e4-6f9ab49849e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.355619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff97b91-6491-4d3b-a5e4-6f9ab49849e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:07.357525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff97b91-6491-4d3b-a5e4-6f9ab49849e0 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:07.379433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1064/2167] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:07 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:07.384699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782025-808a-4ed0-b75d-78408e4dfcf7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:07.398733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782025-808a-4ed0-b75d-78408e4dfcf7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:07.405144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884dee3-104d-4061-b57a-970a118a8b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:07.405820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884dee3-104d-4061-b57a-970a118a8b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.406123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884dee3-104d-4061-b57a-970a118a8b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.406386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884dee3-104d-4061-b57a-970a118a8b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.407565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884dee3-104d-4061-b57a-970a118a8b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:07.409165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884dee3-104d-4061-b57a-970a118a8b0c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:07.420418 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1104/2168] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:23:07.425176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff97b91-6491-4d3b-a5e4-6f9ab49849e0 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:07.439830 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff97b91-6491-4d3b-a5e4-6f9ab49849e0 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:07.448969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2d377-c74e-4940-b737-d9a3a4dbca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:07.449647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2d377-c74e-4940-b737-d9a3a4dbca3b admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.449932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2d377-c74e-4940-b737-d9a3a4dbca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.450261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2d377-c74e-4940-b737-d9a3a4dbca3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.450955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2d377-c74e-4940-b737-d9a3a4dbca3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:07.452601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2d377-c74e-4940-b737-d9a3a4dbca3b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:07.466696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1065/2169] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:07.467896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884dee3-104d-4061-b57a-970a118a8b0c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:07.478482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884dee3-104d-4061-b57a-970a118a8b0c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:07.488398 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c0058-cd55-445e-b7f1-cf79e9910ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:07.491903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c0058-cd55-445e-b7f1-cf79e9910ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.491903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c0058-cd55-445e-b7f1-cf79e9910ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.491903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c0058-cd55-445e-b7f1-cf79e9910ac4 admin admin] PATH_INFO: `/v3/projects/ccb8cecc17c14176808ef6ad15cb6768/users/102ab6cae0d14675ad3dd3bff9e9aab8/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.505007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:07.509912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c0058-cd55-445e-b7f1-cf79e9910ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb8cecc17c14176808ef6ad15cb6768, user_id=102ab6cae0d14675ad3dd3bff9e9aab8, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:07.513087 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c0058-cd55-445e-b7f1-cf79e9910ac4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:07.527758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1105/2170] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:07 2022] PUT /identity/v3/projects/ccb8cecc17c14176808ef6ad15cb6768/users/102ab6cae0d14675ad3dd3bff9e9aab8/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:07.537966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44249-fb2b-4727-9ac2-1e123a346d59 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.538459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44249-fb2b-4727-9ac2-1e123a346d59 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.538559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e44249-fb2b-4727-9ac2-1e123a346d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.565956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-36e44249-fb2b-4727-9ac2-1e123a346d59 None None] MFA Rules not processed for user `102ab6cae0d14675ad3dd3bff9e9aab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:07.567155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-36e44249-fb2b-4727-9ac2-1e123a346d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:07.635929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1066/2171] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:07.647249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c0058-cd55-445e-b7f1-cf79e9910ac4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:07.649266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-807c0058-cd55-445e-b7f1-cf79e9910ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:07.723424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c0058-cd55-445e-b7f1-cf79e9910ac4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:07.727454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad3b6c-e2d7-4139-9310-b198133fdaf2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a418c5817e784d299c8d6daad20c6cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:07.728103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3b6c-e2d7-4139-9310-b198133fdaf2 service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:07.728390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3b6c-e2d7-4139-9310-b198133fdaf2 service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:07.728672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3b6c-e2d7-4139-9310-b198133fdaf2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:07.737243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad3b6c-e2d7-4139-9310-b198133fdaf2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:07.739600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad3b6c-e2d7-4139-9310-b198133fdaf2 service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:07.751883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1106/2172] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:12.447623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e44249-fb2b-4727-9ac2-1e123a346d59 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:12.449044 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-36e44249-fb2b-4727-9ac2-1e123a346d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:12.529531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e44249-fb2b-4727-9ac2-1e123a346d59 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:12.537079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:12.540385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:12.540744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:12.541093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] PATH_INFO: `/v3/users/5d8fd1193b1d4f6497db47446ee3de3a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:12.542429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8fd1193b1d4f6497db47446ee3de3a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:12.544703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:12.554384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:12.607246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8fd1193b1d4f6497db47446ee3de3a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:12.608073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8fd1193b1d4f6497db47446ee3de3a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:12.616111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8fd1193b1d4f6497db47446ee3de3a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:12.616788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8fd1193b1d4f6497db47446ee3de3a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:12.625235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8fd1193b1d4f6497db47446ee3de3a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:12.656193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1067/2173] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:12 2022] DELETE /identity/v3/users/5d8fd1193b1d4f6497db47446ee3de3a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:12.658214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eff97-fd24-4853-b4b4-848367bac02f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:12.658738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eff97-fd24-4853-b4b4-848367bac02f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:12.658929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5eff97-fd24-4853-b4b4-848367bac02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:12.678020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7e5eff97-fd24-4853-b4b4-848367bac02f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:12.678989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7e5eff97-fd24-4853-b4b4-848367bac02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:12.756640 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1107/2174] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:12.766431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:12.767892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:12.835018 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575523b9-eb97-43ed-bbd6-a635b5344c27 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:12.839611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa39a5c-2214-4041-ae35-0a762adfc9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:12.840447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39a5c-2214-4041-ae35-0a762adfc9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:12.840755 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39a5c-2214-4041-ae35-0a762adfc9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:12.841141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39a5c-2214-4041-ae35-0a762adfc9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:12.851866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39a5c-2214-4041-ae35-0a762adfc9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:12.854254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39a5c-2214-4041-ae35-0a762adfc9e3 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:12.865342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1068/2175] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:13.167779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eff97-fd24-4853-b4b4-848367bac02f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:13.169303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7e5eff97-fd24-4853-b4b4-848367bac02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:13.181921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5eff97-fd24-4853-b4b4-848367bac02f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:13.187213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:13.191649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.192115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.192408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] PATH_INFO: `/v3/projects/1c9e56411ed8494daf54da0c327e77c0` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.193872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9e56411ed8494daf54da0c327e77c0)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:13.196638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:13.243719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9e56411ed8494daf54da0c327e77c0', 'request_id': 'req-c13928a0-724b-4ce2-976e-873a908f6d02'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:13.251442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9e56411ed8494daf54da0c327e77c0', 'request_id': 'req-c13928a0-724b-4ce2-976e-873a908f6d02'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:13.258969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9e56411ed8494daf54da0c327e77c0', 'request_id': 'req-c13928a0-724b-4ce2-976e-873a908f6d02'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:13.270219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] The token cache is being invalidate because project 1c9e56411ed8494daf54da0c327e77c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:13.270513 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:13.271199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c13928a0-724b-4ce2-976e-873a908f6d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:13.272803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1108/2176] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:13 2022] DELETE /identity/v3/projects/1c9e56411ed8494daf54da0c327e77c0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:13.278376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b694-75c0-4d65-9ade-52546537a1f7 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.278806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b694-75c0-4d65-9ade-52546537a1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.279084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b694-75c0-4d65-9ade-52546537a1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.296554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6ff1b694-75c0-4d65-9ade-52546537a1f7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:13.297674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6ff1b694-75c0-4d65-9ade-52546537a1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:13.360622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1069/2177] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:13.368399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f6458-27fc-4420-b413-0d3303232f23 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.368693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f6458-27fc-4420-b413-0d3303232f23 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.368978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f6458-27fc-4420-b413-0d3303232f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.387648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-116f6458-27fc-4420-b413-0d3303232f23 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:13.388854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-116f6458-27fc-4420-b413-0d3303232f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:13.396715 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1109/2178] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:13.401525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b694-75c0-4d65-9ade-52546537a1f7 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:13.411273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b694-75c0-4d65-9ade-52546537a1f7 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:13.415884 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf09c5-0756-4fe2-b89b-71382b875ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:13.416560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf09c5-0756-4fe2-b89b-71382b875ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.416843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf09c5-0756-4fe2-b89b-71382b875ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.417138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf09c5-0756-4fe2-b89b-71382b875ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.417853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf09c5-0756-4fe2-b89b-71382b875ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:13.418159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf09c5-0756-4fe2-b89b-71382b875ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:13.419802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf09c5-0756-4fe2-b89b-71382b875ba3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:13.432866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1070/2179] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:13.437013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f6458-27fc-4420-b413-0d3303232f23 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:13.447602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f6458-27fc-4420-b413-0d3303232f23 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:13.452413 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2678824-d72a-486c-8a1c-e0628ce0c121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:13.452998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2678824-d72a-486c-8a1c-e0628ce0c121 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.453286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2678824-d72a-486c-8a1c-e0628ce0c121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.453569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2678824-d72a-486c-8a1c-e0628ce0c121 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.454278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2678824-d72a-486c-8a1c-e0628ce0c121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:13.456257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2678824-d72a-486c-8a1c-e0628ce0c121 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:13.460844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:13.495887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1110/2180] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:13 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:13.499579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf09c5-0756-4fe2-b89b-71382b875ba3 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:13.511750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf09c5-0756-4fe2-b89b-71382b875ba3 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:13.522188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:13.579626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28aec-d50d-44fc-9c1a-67b8ae692f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:13.580606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28aec-d50d-44fc-9c1a-67b8ae692f54 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.580927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28aec-d50d-44fc-9c1a-67b8ae692f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.581211 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be28aec-d50d-44fc-9c1a-67b8ae692f54 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.581961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be28aec-d50d-44fc-9c1a-67b8ae692f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:13.583967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be28aec-d50d-44fc-9c1a-67b8ae692f54 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:13.607205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1071/2181] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:13 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:13.612998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2678824-d72a-486c-8a1c-e0628ce0c121 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:13.624532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2678824-d72a-486c-8a1c-e0628ce0c121 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:13.629321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f850313-cce3-4e6f-873b-87563c652cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:13.630000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f850313-cce3-4e6f-873b-87563c652cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.630328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f850313-cce3-4e6f-873b-87563c652cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.630661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f850313-cce3-4e6f-873b-87563c652cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.631452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f850313-cce3-4e6f-873b-87563c652cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:13.633075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f850313-cce3-4e6f-873b-87563c652cc7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:13.644996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1111/2182] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:13.649260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28aec-d50d-44fc-9c1a-67b8ae692f54 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:13.659474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be28aec-d50d-44fc-9c1a-67b8ae692f54 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:13.664127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb65e14-9d14-4423-8ebc-42c490e373d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:13.664811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb65e14-9d14-4423-8ebc-42c490e373d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.665095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb65e14-9d14-4423-8ebc-42c490e373d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.665371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb65e14-9d14-4423-8ebc-42c490e373d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.666101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb65e14-9d14-4423-8ebc-42c490e373d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:13.667725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb65e14-9d14-4423-8ebc-42c490e373d8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:13.677540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1072/2183] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:13.682462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f850313-cce3-4e6f-873b-87563c652cc7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:13.692380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f850313-cce3-4e6f-873b-87563c652cc7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:13.697818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7df20-7b96-4e31-9b61-d2159720899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:13.698686 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7df20-7b96-4e31-9b61-d2159720899b admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.698967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7df20-7b96-4e31-9b61-d2159720899b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.699242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7df20-7b96-4e31-9b61-d2159720899b admin admin] PATH_INFO: `/v3/projects/73d58e3033734ad6977d1a0ee47aaaf5/users/8773fb27af9d48a7b9152525a509a6b5/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.713659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7df20-7b96-4e31-9b61-d2159720899b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d58e3033734ad6977d1a0ee47aaaf5, user_id=8773fb27af9d48a7b9152525a509a6b5, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:13.716321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7df20-7b96-4e31-9b61-d2159720899b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:13.732268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1112/2184] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:13 2022] PUT /identity/v3/projects/73d58e3033734ad6977d1a0ee47aaaf5/users/8773fb27af9d48a7b9152525a509a6b5/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:23:13.743939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7f49-b718-4d1c-9306-9b628d9cbe1d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.744331 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7f49-b718-4d1c-9306-9b628d9cbe1d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.744496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7f49-b718-4d1c-9306-9b628d9cbe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.772209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-318e7f49-b718-4d1c-9306-9b628d9cbe1d None None] MFA Rules not processed for user `8773fb27af9d48a7b9152525a509a6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:13.773402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-318e7f49-b718-4d1c-9306-9b628d9cbe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:13.844847 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1073/2185] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:13.849323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7df20-7b96-4e31-9b61-d2159720899b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:13.926969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7df20-7b96-4e31-9b61-d2159720899b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:13.932243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b48dab-4747-4c80-9a3a-e0929117dd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:13.932906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b48dab-4747-4c80-9a3a-e0929117dd7d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:13.933186 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b48dab-4747-4c80-9a3a-e0929117dd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:13.933467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b48dab-4747-4c80-9a3a-e0929117dd7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:13.934330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b48dab-4747-4c80-9a3a-e0929117dd7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:13.936216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b48dab-4747-4c80-9a3a-e0929117dd7d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:13.997328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1113/2186] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:13 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:14.000942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7f49-b718-4d1c-9306-9b628d9cbe1d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:14.016819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7f49-b718-4d1c-9306-9b628d9cbe1d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:14.110782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784f318-cf58-4dc2-bb94-d8dd1dbdd06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:14.111696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784f318-cf58-4dc2-bb94-d8dd1dbdd06a admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:14.111982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784f318-cf58-4dc2-bb94-d8dd1dbdd06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:14.112261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784f318-cf58-4dc2-bb94-d8dd1dbdd06a admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:14.112956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784f318-cf58-4dc2-bb94-d8dd1dbdd06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:14.115047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784f318-cf58-4dc2-bb94-d8dd1dbdd06a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:14.135626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1074/2187] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:13 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:14.139954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b48dab-4747-4c80-9a3a-e0929117dd7d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:14.150875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b48dab-4747-4c80-9a3a-e0929117dd7d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:14.155555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c799dd-6db2-4b1b-9cc2-c88c232643e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:14.156221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c799dd-6db2-4b1b-9cc2-c88c232643e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:14.156502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c799dd-6db2-4b1b-9cc2-c88c232643e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:14.156780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c799dd-6db2-4b1b-9cc2-c88c232643e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:14.157509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c799dd-6db2-4b1b-9cc2-c88c232643e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:14.159083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c799dd-6db2-4b1b-9cc2-c88c232643e4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:14.170093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1114/2188] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:23:14.174143 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784f318-cf58-4dc2-bb94-d8dd1dbdd06a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:14.184087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784f318-cf58-4dc2-bb94-d8dd1dbdd06a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:14.188686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56c53-d562-482f-96d7-4fe991d86e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:14.190113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56c53-d562-482f-96d7-4fe991d86e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:14.190396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56c53-d562-482f-96d7-4fe991d86e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:14.190668 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c56c53-d562-482f-96d7-4fe991d86e1d admin admin] PATH_INFO: `/v3/projects/9f52da2b865a4579a53b9f245b847ae8/users/3e526d05e7524c0db8da4796f1631f26/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:14.200499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:14.208013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c56c53-d562-482f-96d7-4fe991d86e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f52da2b865a4579a53b9f245b847ae8, user_id=3e526d05e7524c0db8da4796f1631f26, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:14.211089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c56c53-d562-482f-96d7-4fe991d86e1d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:14.224369 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1075/2189] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:14 2022] PUT /identity/v3/projects/9f52da2b865a4579a53b9f245b847ae8/users/3e526d05e7524c0db8da4796f1631f26/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:14.228760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c799dd-6db2-4b1b-9cc2-c88c232643e4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:14.239161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c799dd-6db2-4b1b-9cc2-c88c232643e4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:14.302264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99da77d-70a7-46de-8e01-bea5b25cd203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:14.302933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99da77d-70a7-46de-8e01-bea5b25cd203 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:14.303216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99da77d-70a7-46de-8e01-bea5b25cd203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:14.303532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99da77d-70a7-46de-8e01-bea5b25cd203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:14.304262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99da77d-70a7-46de-8e01-bea5b25cd203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:14.305844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99da77d-70a7-46de-8e01-bea5b25cd203 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:14.315869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1115/2190] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:14.320619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56c53-d562-482f-96d7-4fe991d86e1d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:14.331982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c56c53-d562-482f-96d7-4fe991d86e1d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:14.337124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c985247-c0fe-45d0-adf0-d0f4e5884244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:14.338017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c985247-c0fe-45d0-adf0-d0f4e5884244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:14.338307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c985247-c0fe-45d0-adf0-d0f4e5884244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:14.338582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c985247-c0fe-45d0-adf0-d0f4e5884244 admin admin] PATH_INFO: `/v3/projects/9f52da2b865a4579a53b9f245b847ae8/users/3e526d05e7524c0db8da4796f1631f26/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:14.340835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c985247-c0fe-45d0-adf0-d0f4e5884244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f52da2b865a4579a53b9f245b847ae8, user_id=3e526d05e7524c0db8da4796f1631f26, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:14.343973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c985247-c0fe-45d0-adf0-d0f4e5884244 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:14.356113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1076/2191] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:14 2022] PUT /identity/v3/projects/9f52da2b865a4579a53b9f245b847ae8/users/3e526d05e7524c0db8da4796f1631f26/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:23:14.367028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6e688-6209-484f-b43f-9841f74eb0d5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:14.367307 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6e688-6209-484f-b43f-9841f74eb0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:14.368119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6e688-6209-484f-b43f-9841f74eb0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:14.394889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-89a6e688-6209-484f-b43f-9841f74eb0d5 None None] MFA Rules not processed for user `3e526d05e7524c0db8da4796f1631f26`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:14.396132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-89a6e688-6209-484f-b43f-9841f74eb0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:14.405083 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:14.467166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1116/2192] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:23:14.477666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c985247-c0fe-45d0-adf0-d0f4e5884244 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:14.479449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5c985247-c0fe-45d0-adf0-d0f4e5884244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:14.537060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c985247-c0fe-45d0-adf0-d0f4e5884244 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:14.541853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f752c5a-d00d-475d-adc2-df1aef7789c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:14.542937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f752c5a-d00d-475d-adc2-df1aef7789c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:14.542937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f752c5a-d00d-475d-adc2-df1aef7789c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:14.543143 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f752c5a-d00d-475d-adc2-df1aef7789c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:14.625441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f752c5a-d00d-475d-adc2-df1aef7789c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:14.626877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f752c5a-d00d-475d-adc2-df1aef7789c0 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:14.638450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1077/2193] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:17.194638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6e688-6209-484f-b43f-9841f74eb0d5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:17.259480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6e688-6209-484f-b43f-9841f74eb0d5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:17.264122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:17.265001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:17.265286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:17.265566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] PATH_INFO: `/v3/users/8773fb27af9d48a7b9152525a509a6b5` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:17.266764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8773fb27af9d48a7b9152525a509a6b5)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:17.268728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:17.317177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8773fb27af9d48a7b9152525a509a6b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.326289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8773fb27af9d48a7b9152525a509a6b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.327187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8773fb27af9d48a7b9152525a509a6b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.335878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8773fb27af9d48a7b9152525a509a6b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.348501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8773fb27af9d48a7b9152525a509a6b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.355176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1117/2194] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:17 2022] DELETE /identity/v3/users/8773fb27af9d48a7b9152525a509a6b5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:17.359673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866e7ea-526d-4586-a8c2-561e9d5b55fc None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:17.360149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866e7ea-526d-4586-a8c2-561e9d5b55fc None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:17.360257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866e7ea-526d-4586-a8c2-561e9d5b55fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:17.377313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-f866e7ea-526d-4586-a8c2-561e9d5b55fc None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:17.378765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f866e7ea-526d-4586-a8c2-561e9d5b55fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:17.443394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1078/2195] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:17.453223 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:17.454638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:17.488770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:17.520860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a711029-c39d-4e5b-af2b-7ff3e249dbf7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:17.525325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dd998-3468-438f-b50a-6ba2e496ebff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:17.525962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dd998-3468-438f-b50a-6ba2e496ebff service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:17.526256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dd998-3468-438f-b50a-6ba2e496ebff service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:17.526538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dd998-3468-438f-b50a-6ba2e496ebff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:17.535987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dd998-3468-438f-b50a-6ba2e496ebff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:17.537261 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dd998-3468-438f-b50a-6ba2e496ebff service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:17.546965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1118/2196] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:17.840224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866e7ea-526d-4586-a8c2-561e9d5b55fc None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:17.841743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f866e7ea-526d-4586-a8c2-561e9d5b55fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:17.862180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866e7ea-526d-4586-a8c2-561e9d5b55fc None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:17.867750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:17.868665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:17.868945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:17.869159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] PATH_INFO: `/v3/projects/73d58e3033734ad6977d1a0ee47aaaf5` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:17.870402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d58e3033734ad6977d1a0ee47aaaf5)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:17.872630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:17.900624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:17.925986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d58e3033734ad6977d1a0ee47aaaf5', 'request_id': 'req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.933061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d58e3033734ad6977d1a0ee47aaaf5', 'request_id': 'req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.941750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d58e3033734ad6977d1a0ee47aaaf5', 'request_id': 'req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.953144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] The token cache is being invalidate because project 73d58e3033734ad6977d1a0ee47aaaf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:17.953391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.954016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:17.955724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1079/2197] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:17 2022] DELETE /identity/v3/projects/73d58e3033734ad6977d1a0ee47aaaf5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:17.959948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dd998-3468-438f-b50a-6ba2e496ebff service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:17.969826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dd998-3468-438f-b50a-6ba2e496ebff service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:18.027992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:18.028913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:18.029195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:18.029470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] PATH_INFO: `/v3/users/3e526d05e7524c0db8da4796f1631f26` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:18.030649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e526d05e7524c0db8da4796f1631f26)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:18.032662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:18.082166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e526d05e7524c0db8da4796f1631f26'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.088875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e526d05e7524c0db8da4796f1631f26'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.089534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e526d05e7524c0db8da4796f1631f26'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.096863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e526d05e7524c0db8da4796f1631f26'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.108815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8deb6ce-a8e6-43cc-9768-dc5febb1e6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e526d05e7524c0db8da4796f1631f26'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.115075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1119/2198] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:17 2022] DELETE /identity/v3/users/3e526d05e7524c0db8da4796f1631f26 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:18.472299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:18.473731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:18.502611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90a0d-ff95-4a98-a1fc-1534ae7ba109 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:18.566269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:18.567160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:18.567487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:18.567768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] PATH_INFO: `/v3/projects/9f52da2b865a4579a53b9f245b847ae8` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:18.568964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f52da2b865a4579a53b9f245b847ae8)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:18.571185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:18.621403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f52da2b865a4579a53b9f245b847ae8', 'request_id': 'req-52d06664-adfa-4c4f-997d-906e23398763'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.627324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f52da2b865a4579a53b9f245b847ae8', 'request_id': 'req-52d06664-adfa-4c4f-997d-906e23398763'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.634427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f52da2b865a4579a53b9f245b847ae8', 'request_id': 'req-52d06664-adfa-4c4f-997d-906e23398763'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.644669 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] The token cache is being invalidate because project 9f52da2b865a4579a53b9f245b847ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:18.644965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.645564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-52d06664-adfa-4c4f-997d-906e23398763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:18.647086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1080/2199] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:18 2022] DELETE /identity/v3/projects/9f52da2b865a4579a53b9f245b847ae8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:18.652583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393000-0645-4328-a304-5438a9165548 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:18.653100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393000-0645-4328-a304-5438a9165548 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:18.653201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec393000-0645-4328-a304-5438a9165548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:18.671220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ec393000-0645-4328-a304-5438a9165548 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:18.672442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ec393000-0645-4328-a304-5438a9165548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:18.724175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:18.745252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1120/2200] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:18.756460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6103e0-626d-481c-a429-1ddb4661396a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:18.757010 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6103e0-626d-481c-a429-1ddb4661396a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:18.757495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6103e0-626d-481c-a429-1ddb4661396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:18.781519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-0a6103e0-626d-481c-a429-1ddb4661396a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:18.783186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0a6103e0-626d-481c-a429-1ddb4661396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:18.792118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1081/2201] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:18.796921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec393000-0645-4328-a304-5438a9165548 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:18.808352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec393000-0645-4328-a304-5438a9165548 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:18.813649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8a763-a157-4d7a-a51b-194a141297ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:18.814322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a763-a157-4d7a-a51b-194a141297ec admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:18.815906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a763-a157-4d7a-a51b-194a141297ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:18.816463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a763-a157-4d7a-a51b-194a141297ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:18.817649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a763-a157-4d7a-a51b-194a141297ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:18.818166 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a763-a157-4d7a-a51b-194a141297ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:18.820558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a763-a157-4d7a-a51b-194a141297ec admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:18.837357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1121/2202] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:18.838545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6103e0-626d-481c-a429-1ddb4661396a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:18.847813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6103e0-626d-481c-a429-1ddb4661396a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:18.853193 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8d120-31d1-43e8-b913-0f39328fa7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:18.853853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8d120-31d1-43e8-b913-0f39328fa7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:18.854137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8d120-31d1-43e8-b913-0f39328fa7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:18.854415 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8d120-31d1-43e8-b913-0f39328fa7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:18.855106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8d120-31d1-43e8-b913-0f39328fa7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:18.857052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8d120-31d1-43e8-b913-0f39328fa7f9 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:18.883136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1082/2203] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:18 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:18.887277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8a763-a157-4d7a-a51b-194a141297ec admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:18.897131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8a763-a157-4d7a-a51b-194a141297ec admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:18.953305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0856-8819-4aac-b306-5af58db2363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:18.953975 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0856-8819-4aac-b306-5af58db2363f admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:18.954281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0856-8819-4aac-b306-5af58db2363f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:18.954563 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0856-8819-4aac-b306-5af58db2363f admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:18.955266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a0856-8819-4aac-b306-5af58db2363f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:18.957369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a0856-8819-4aac-b306-5af58db2363f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:18.984259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1122/2204] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:18 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:18.988446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8d120-31d1-43e8-b913-0f39328fa7f9 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:19.000466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8d120-31d1-43e8-b913-0f39328fa7f9 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:19.005113 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6f80-6f26-4f46-ba87-dbcd682036c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:19.005781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6f80-6f26-4f46-ba87-dbcd682036c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:19.006062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6f80-6f26-4f46-ba87-dbcd682036c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:19.006332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6f80-6f26-4f46-ba87-dbcd682036c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:19.007130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6f80-6f26-4f46-ba87-dbcd682036c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:19.009998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6f80-6f26-4f46-ba87-dbcd682036c2 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:19.021110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1083/2205] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:19.025650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0856-8819-4aac-b306-5af58db2363f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:19.036207 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0856-8819-4aac-b306-5af58db2363f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:19.044123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989a68-95f4-44ec-bae7-1ded16aacd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:19.044123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989a68-95f4-44ec-bae7-1ded16aacd75 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:19.044123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989a68-95f4-44ec-bae7-1ded16aacd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:19.044123 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989a68-95f4-44ec-bae7-1ded16aacd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:19.044620 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93989a68-95f4-44ec-bae7-1ded16aacd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:19.045600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93989a68-95f4-44ec-bae7-1ded16aacd75 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:19.057244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1123/2206] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:19.062268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6f80-6f26-4f46-ba87-dbcd682036c2 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:19.068205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:19.078566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6f80-6f26-4f46-ba87-dbcd682036c2 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:19.087292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152318e7-147d-40a1-9bfd-c481b7da6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:19.088217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152318e7-147d-40a1-9bfd-c481b7da6905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:19.088496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152318e7-147d-40a1-9bfd-c481b7da6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:19.088769 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152318e7-147d-40a1-9bfd-c481b7da6905 admin admin] PATH_INFO: `/v3/projects/ac7b3b6fdb134baa87ad81240dc70fc9/users/4a6a2445de7c476fb5558f580e04fbe4/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:19.104705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152318e7-147d-40a1-9bfd-c481b7da6905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7b3b6fdb134baa87ad81240dc70fc9, user_id=4a6a2445de7c476fb5558f580e04fbe4, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:19.111291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152318e7-147d-40a1-9bfd-c481b7da6905 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:19.132241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1084/2207] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:19 2022] PUT /identity/v3/projects/ac7b3b6fdb134baa87ad81240dc70fc9/users/4a6a2445de7c476fb5558f580e04fbe4/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:19.203461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ee154-637a-488b-bf45-e61a336e64ab None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:19.203776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ee154-637a-488b-bf45-e61a336e64ab None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:19.204011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ee154-637a-488b-bf45-e61a336e64ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:19.243698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-569ee154-637a-488b-bf45-e61a336e64ab None None] MFA Rules not processed for user `4a6a2445de7c476fb5558f580e04fbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:19.244969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-569ee154-637a-488b-bf45-e61a336e64ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:19.322922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1124/2208] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:19.334164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152318e7-147d-40a1-9bfd-c481b7da6905 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:19.336069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-152318e7-147d-40a1-9bfd-c481b7da6905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:19.393394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152318e7-147d-40a1-9bfd-c481b7da6905 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:19.397073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbf411-a8f2-49a8-8d1f-7a9e57e8ff07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:19.397749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbf411-a8f2-49a8-8d1f-7a9e57e8ff07 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:19.398033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbf411-a8f2-49a8-8d1f-7a9e57e8ff07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:19.398309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbf411-a8f2-49a8-8d1f-7a9e57e8ff07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:19.407822 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbf411-a8f2-49a8-8d1f-7a9e57e8ff07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:19.409253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbf411-a8f2-49a8-8d1f-7a9e57e8ff07 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:19.418844 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1085/2209] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:22.050994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ee154-637a-488b-bf45-e61a336e64ab None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:22.151367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:22.172883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ee154-637a-488b-bf45-e61a336e64ab None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:22.178762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:22.179191 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:22.179624 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:22.180044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] PATH_INFO: `/v3/users/4a6a2445de7c476fb5558f580e04fbe4` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:22.181610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6a2445de7c476fb5558f580e04fbe4)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:22.183762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:22.236051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6a2445de7c476fb5558f580e04fbe4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:22.243641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6a2445de7c476fb5558f580e04fbe4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:22.244488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6a2445de7c476fb5558f580e04fbe4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:22.252427 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6a2445de7c476fb5558f580e04fbe4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:22.268408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6a2445de7c476fb5558f580e04fbe4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:22.279090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1125/2210] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:22 2022] DELETE /identity/v3/users/4a6a2445de7c476fb5558f580e04fbe4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:22.281521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449b4d-b80f-46eb-aa6b-4582a7ce2149 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:22.282377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449b4d-b80f-46eb-aa6b-4582a7ce2149 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:22.282730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb449b4d-b80f-46eb-aa6b-4582a7ce2149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:22.306057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-eb449b4d-b80f-46eb-aa6b-4582a7ce2149 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:22.307378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eb449b4d-b80f-46eb-aa6b-4582a7ce2149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:22.384489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1086/2211] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:22.406005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:22.407592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:22.528944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a168f-0ff5-4a43-bdd8-699fa7a4bd16 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:22.533677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d17595-ad48-492b-945e-376cf8a30f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:22.534519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d17595-ad48-492b-945e-376cf8a30f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:22.534971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d17595-ad48-492b-945e-376cf8a30f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:22.535668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d17595-ad48-492b-945e-376cf8a30f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:22.547763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d17595-ad48-492b-945e-376cf8a30f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:22.555239 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d17595-ad48-492b-945e-376cf8a30f68 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:22.574041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1126/2212] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:23.054056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb449b4d-b80f-46eb-aa6b-4582a7ce2149 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:23.056307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eb449b4d-b80f-46eb-aa6b-4582a7ce2149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:23.079974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb449b4d-b80f-46eb-aa6b-4582a7ce2149 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:23.087953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:23.088826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:23.089176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:23.089452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] PATH_INFO: `/v3/projects/ac7b3b6fdb134baa87ad81240dc70fc9` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:23.090903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7b3b6fdb134baa87ad81240dc70fc9)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:23.093518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:23.144411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7b3b6fdb134baa87ad81240dc70fc9', 'request_id': 'req-55b5ee82-69a6-430c-95b5-8eaa2a804343'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:23.152047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7b3b6fdb134baa87ad81240dc70fc9', 'request_id': 'req-55b5ee82-69a6-430c-95b5-8eaa2a804343'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:23.162259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7b3b6fdb134baa87ad81240dc70fc9', 'request_id': 'req-55b5ee82-69a6-430c-95b5-8eaa2a804343'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:23.173769 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] The token cache is being invalidate because project ac7b3b6fdb134baa87ad81240dc70fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:23.174053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:23.174692 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:23.176444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1087/2213] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:23 2022] DELETE /identity/v3/projects/ac7b3b6fdb134baa87ad81240dc70fc9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:27.153128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d17595-ad48-492b-945e-376cf8a30f68 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:27.155100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a4d17595-ad48-492b-945e-376cf8a30f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:27.168520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d17595-ad48-492b-945e-376cf8a30f68 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:27.226722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:27.228246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:27.228531 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:27.228811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] PATH_INFO: `/v3/users/dbe443fb65c44907bdda10967fed340e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:27.230062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe443fb65c44907bdda10967fed340e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:27.232028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:27.237752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:27.286661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe443fb65c44907bdda10967fed340e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.293454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe443fb65c44907bdda10967fed340e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.294113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe443fb65c44907bdda10967fed340e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.301386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe443fb65c44907bdda10967fed340e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.313106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe443fb65c44907bdda10967fed340e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.319243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1127/2214] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:27 2022] DELETE /identity/v3/users/dbe443fb65c44907bdda10967fed340e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:27.494425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:27.498011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:27.509899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:27.515121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ee82-69a6-430c-95b5-8eaa2a804343 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:27.573998 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:27.574858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:27.575142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:27.575454 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] PATH_INFO: `/v3/projects/e74c682c054d4a598139e097f889c966` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:27.576641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74c682c054d4a598139e097f889c966)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:27.578548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:27.626071 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74c682c054d4a598139e097f889c966', 'request_id': 'req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.632359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74c682c054d4a598139e097f889c966', 'request_id': 'req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.640562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74c682c054d4a598139e097f889c966', 'request_id': 'req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.651260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] The token cache is being invalidate because project e74c682c054d4a598139e097f889c966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:27.651583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.652235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.653970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1088/2215] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:27 2022] DELETE /identity/v3/projects/e74c682c054d4a598139e097f889c966 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:27.657779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:27.659174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:27.671826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb219b2-ae79-4bcf-a089-7ee3326bba8a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:27.730761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:27.731709 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:27.731995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:27.732274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] PATH_INFO: `/v3/users/2ff33d409a0a4b8c865e6a3b05abb456` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:27.733481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff33d409a0a4b8c865e6a3b05abb456)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:27.735421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:27.784889 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff33d409a0a4b8c865e6a3b05abb456'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.793188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff33d409a0a4b8c865e6a3b05abb456'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.793962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff33d409a0a4b8c865e6a3b05abb456'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.800952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff33d409a0a4b8c865e6a3b05abb456'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.813266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-630a038c-fae7-41f3-a4a9-fd55363361d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff33d409a0a4b8c865e6a3b05abb456'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:27.819516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1128/2216] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:27 2022] DELETE /identity/v3/users/2ff33d409a0a4b8c865e6a3b05abb456 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:27.995731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:27.997178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:28.011154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c13b2-273b-4efe-ab5a-1b8ba88fa1c0 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:28.072405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:28.073229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.073510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.073790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] PATH_INFO: `/v3/projects/c1ec5cf0e4dc409893e83c55946120f9` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.074946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ec5cf0e4dc409893e83c55946120f9)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:28.076866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:28.113745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:28.123410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ec5cf0e4dc409893e83c55946120f9', 'request_id': 'req-3abc4d50-5445-45fe-8b50-3ebbced3c00d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.129812 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ec5cf0e4dc409893e83c55946120f9', 'request_id': 'req-3abc4d50-5445-45fe-8b50-3ebbced3c00d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.137513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ec5cf0e4dc409893e83c55946120f9', 'request_id': 'req-3abc4d50-5445-45fe-8b50-3ebbced3c00d'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.148019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] The token cache is being invalidate because project c1ec5cf0e4dc409893e83c55946120f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:28.148307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.148939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-3abc4d50-5445-45fe-8b50-3ebbced3c00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.151053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1089/2217] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:27 2022] DELETE /identity/v3/projects/c1ec5cf0e4dc409893e83c55946120f9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:28.156646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13923d1-197a-48b8-a3b0-4f3f7f575b7e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.157144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13923d1-197a-48b8-a3b0-4f3f7f575b7e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.157254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13923d1-197a-48b8-a3b0-4f3f7f575b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.164517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:28.176677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e13923d1-197a-48b8-a3b0-4f3f7f575b7e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:28.178303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e13923d1-197a-48b8-a3b0-4f3f7f575b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:28.236741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1129/2218] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:28.244963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507eb27-c183-48fa-b394-9c61ffa95264 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.245256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507eb27-c183-48fa-b394-9c61ffa95264 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.245536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507eb27-c183-48fa-b394-9c61ffa95264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.264309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-c507eb27-c183-48fa-b394-9c61ffa95264 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:28.265508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c507eb27-c183-48fa-b394-9c61ffa95264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:28.273568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1090/2219] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:28.278316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13923d1-197a-48b8-a3b0-4f3f7f575b7e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:28.288388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13923d1-197a-48b8-a3b0-4f3f7f575b7e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:28.293085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcda57-3b7c-4eaf-bf06-8b8cc9b664ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:28.293744 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcda57-3b7c-4eaf-bf06-8b8cc9b664ab admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.294046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcda57-3b7c-4eaf-bf06-8b8cc9b664ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.294312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcda57-3b7c-4eaf-bf06-8b8cc9b664ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.295057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcda57-3b7c-4eaf-bf06-8b8cc9b664ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:28.295432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcda57-3b7c-4eaf-bf06-8b8cc9b664ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:28.297244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcda57-3b7c-4eaf-bf06-8b8cc9b664ab admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:28.311188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1130/2220] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:23:28.315418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507eb27-c183-48fa-b394-9c61ffa95264 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:28.326331 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507eb27-c183-48fa-b394-9c61ffa95264 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:28.331916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a774f-28db-41a9-8fd9-e29e67e298a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:28.332696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a774f-28db-41a9-8fd9-e29e67e298a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.332987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a774f-28db-41a9-8fd9-e29e67e298a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.333265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a774f-28db-41a9-8fd9-e29e67e298a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.333974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a774f-28db-41a9-8fd9-e29e67e298a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:28.336072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a774f-28db-41a9-8fd9-e29e67e298a5 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:28.361505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1091/2221] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:28 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:28.365646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcda57-3b7c-4eaf-bf06-8b8cc9b664ab admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:28.376162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcda57-3b7c-4eaf-bf06-8b8cc9b664ab admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:28.435953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab4a56-9e11-4a6f-92ca-7a0afe6f8da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:28.436752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab4a56-9e11-4a6f-92ca-7a0afe6f8da2 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.437201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab4a56-9e11-4a6f-92ca-7a0afe6f8da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.437576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab4a56-9e11-4a6f-92ca-7a0afe6f8da2 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.438356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab4a56-9e11-4a6f-92ca-7a0afe6f8da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:28.440394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab4a56-9e11-4a6f-92ca-7a0afe6f8da2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:28.460803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1131/2222] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:28 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:28.465028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a774f-28db-41a9-8fd9-e29e67e298a5 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:28.475820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a774f-28db-41a9-8fd9-e29e67e298a5 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:28.480483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f434-6e65-4fec-bb29-4988bb2de3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:28.481145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f434-6e65-4fec-bb29-4988bb2de3cf admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.481432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f434-6e65-4fec-bb29-4988bb2de3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.481712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f434-6e65-4fec-bb29-4988bb2de3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.482449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f434-6e65-4fec-bb29-4988bb2de3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:28.484094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f434-6e65-4fec-bb29-4988bb2de3cf admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:28.498276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1092/2223] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:28.501298 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab4a56-9e11-4a6f-92ca-7a0afe6f8da2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:28.512129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab4a56-9e11-4a6f-92ca-7a0afe6f8da2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:28.516892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbda02a-2fa7-4dee-97ed-d025036c7c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:28.517552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbda02a-2fa7-4dee-97ed-d025036c7c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.517838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbda02a-2fa7-4dee-97ed-d025036c7c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.518255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbda02a-2fa7-4dee-97ed-d025036c7c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.518992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbda02a-2fa7-4dee-97ed-d025036c7c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:28.520614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbda02a-2fa7-4dee-97ed-d025036c7c96 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:28.530417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1132/2224] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:28.534437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f434-6e65-4fec-bb29-4988bb2de3cf admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:28.544490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f434-6e65-4fec-bb29-4988bb2de3cf admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:28.549432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748989-024c-4620-92b3-803cfc4def37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:28.550317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748989-024c-4620-92b3-803cfc4def37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.550604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748989-024c-4620-92b3-803cfc4def37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.550883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748989-024c-4620-92b3-803cfc4def37 admin admin] PATH_INFO: `/v3/projects/6626db5bd40b489983776e05424b39d1/users/ef8c8b6c84e14eb8aefd9cec335a78a8/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.565951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19748989-024c-4620-92b3-803cfc4def37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6626db5bd40b489983776e05424b39d1, user_id=ef8c8b6c84e14eb8aefd9cec335a78a8, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:28.568690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19748989-024c-4620-92b3-803cfc4def37 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:28.582285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1093/2225] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:28 2022] PUT /identity/v3/projects/6626db5bd40b489983776e05424b39d1/users/ef8c8b6c84e14eb8aefd9cec335a78a8/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:28.591929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbe7da-1fab-4ea8-b9ad-ad10bbe6176e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.592226 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbe7da-1fab-4ea8-b9ad-ad10bbe6176e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.592534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbe7da-1fab-4ea8-b9ad-ad10bbe6176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.619315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-77cbe7da-1fab-4ea8-b9ad-ad10bbe6176e None None] MFA Rules not processed for user `ef8c8b6c84e14eb8aefd9cec335a78a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:28.620542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-77cbe7da-1fab-4ea8-b9ad-ad10bbe6176e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:28.681557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:28.685647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1133/2226] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:23:28.697322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748989-024c-4620-92b3-803cfc4def37 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:28.699003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-19748989-024c-4620-92b3-803cfc4def37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:28.755209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748989-024c-4620-92b3-803cfc4def37 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:28.758877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2f637-db8a-4cb2-81db-44eccecbc57d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:28.759558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2f637-db8a-4cb2-81db-44eccecbc57d service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.759859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2f637-db8a-4cb2-81db-44eccecbc57d service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.760124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2f637-db8a-4cb2-81db-44eccecbc57d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.768485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2f637-db8a-4cb2-81db-44eccecbc57d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:28.769917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a2f637-db8a-4cb2-81db-44eccecbc57d service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:28.778816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1094/2227] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:28.798695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbe7da-1fab-4ea8-b9ad-ad10bbe6176e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:28.862663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbe7da-1fab-4ea8-b9ad-ad10bbe6176e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:28.867200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:28.868697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.868981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.869258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] PATH_INFO: `/v3/users/ef8c8b6c84e14eb8aefd9cec335a78a8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.870470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8c8b6c84e14eb8aefd9cec335a78a8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:28.872456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:28.919564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8c8b6c84e14eb8aefd9cec335a78a8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.926715 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8c8b6c84e14eb8aefd9cec335a78a8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.927464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8c8b6c84e14eb8aefd9cec335a78a8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.935805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8c8b6c84e14eb8aefd9cec335a78a8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.948597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8c8b6c84e14eb8aefd9cec335a78a8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:28.954753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1134/2228] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:28 2022] DELETE /identity/v3/users/ef8c8b6c84e14eb8aefd9cec335a78a8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:28.959145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178add45-97b6-4209-b3f2-7529933a7c78 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:28.959475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178add45-97b6-4209-b3f2-7529933a7c78 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:28.959758 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178add45-97b6-4209-b3f2-7529933a7c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:28.976814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-178add45-97b6-4209-b3f2-7529933a7c78 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:28.978578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-178add45-97b6-4209-b3f2-7529933a7c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:29.040372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1095/2229] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:29.050069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:29.051551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:29.110891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f64ac-dd99-4610-970d-4788cf0dca8c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:29.114658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0897c-14a5-43ea-9dab-748bce7ef6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:29.115235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0897c-14a5-43ea-9dab-748bce7ef6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.115544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0897c-14a5-43ea-9dab-748bce7ef6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.115818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0897c-14a5-43ea-9dab-748bce7ef6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.125269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0897c-14a5-43ea-9dab-748bce7ef6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:29.126677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0897c-14a5-43ea-9dab-748bce7ef6d9 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:29.135952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1135/2230] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:29.409815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178add45-97b6-4209-b3f2-7529933a7c78 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:29.411230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-178add45-97b6-4209-b3f2-7529933a7c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:29.419990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:29.433827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178add45-97b6-4209-b3f2-7529933a7c78 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:29.438424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:29.439295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.439612 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.439890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] PATH_INFO: `/v3/projects/6626db5bd40b489983776e05424b39d1` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.441082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6626db5bd40b489983776e05424b39d1)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:29.443094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:29.490495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6626db5bd40b489983776e05424b39d1', 'request_id': 'req-c7bd1ab5-f695-433d-97bb-d0325aa7d535'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:29.497376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6626db5bd40b489983776e05424b39d1', 'request_id': 'req-c7bd1ab5-f695-433d-97bb-d0325aa7d535'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:29.505573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6626db5bd40b489983776e05424b39d1', 'request_id': 'req-c7bd1ab5-f695-433d-97bb-d0325aa7d535'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:29.516007 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] The token cache is being invalidate because project 6626db5bd40b489983776e05424b39d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:29.516295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:29.516971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c7bd1ab5-f695-433d-97bb-d0325aa7d535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:29.518548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1096/2231] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:29 2022] DELETE /identity/v3/projects/6626db5bd40b489983776e05424b39d1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:29.523449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d007f-1fd1-45ce-ba98-a17723c8ea18 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.523860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d007f-1fd1-45ce-ba98-a17723c8ea18 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.524032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d007f-1fd1-45ce-ba98-a17723c8ea18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.541834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f38d007f-1fd1-45ce-ba98-a17723c8ea18 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:29.543006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f38d007f-1fd1-45ce-ba98-a17723c8ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:29.559798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:29.603181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1136/2232] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:23:29.610885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74014180-0f20-4341-b8af-47d2840ed4c7 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.611214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74014180-0f20-4341-b8af-47d2840ed4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.611526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74014180-0f20-4341-b8af-47d2840ed4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.630053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-74014180-0f20-4341-b8af-47d2840ed4c7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:29.631259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-74014180-0f20-4341-b8af-47d2840ed4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:29.639191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1097/2233] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:23:29.643194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d007f-1fd1-45ce-ba98-a17723c8ea18 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:29.652700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d007f-1fd1-45ce-ba98-a17723c8ea18 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:29.657200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0985c-a92d-4d4e-8cb4-da9132f98feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:29.657841 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0985c-a92d-4d4e-8cb4-da9132f98feb admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.658118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0985c-a92d-4d4e-8cb4-da9132f98feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.658391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0985c-a92d-4d4e-8cb4-da9132f98feb admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.659108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0985c-a92d-4d4e-8cb4-da9132f98feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:29.659447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0985c-a92d-4d4e-8cb4-da9132f98feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:29.661011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0985c-a92d-4d4e-8cb4-da9132f98feb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:29.672862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1137/2234] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:23:29.676972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74014180-0f20-4341-b8af-47d2840ed4c7 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:29.686838 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74014180-0f20-4341-b8af-47d2840ed4c7 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:29.691536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57e05-fa9d-446c-b187-1b461495c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:29.692188 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57e05-fa9d-446c-b187-1b461495c787 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.692474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57e05-fa9d-446c-b187-1b461495c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.692759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57e05-fa9d-446c-b187-1b461495c787 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.693443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57e05-fa9d-446c-b187-1b461495c787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:29.695616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57e05-fa9d-446c-b187-1b461495c787 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:29.720727 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1098/2235] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:29 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:29.724682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0985c-a92d-4d4e-8cb4-da9132f98feb admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:29.735126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0985c-a92d-4d4e-8cb4-da9132f98feb admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:29.791244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c5956-111b-438e-8c3b-db45cd303860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:29.791939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5956-111b-438e-8c3b-db45cd303860 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.792222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5956-111b-438e-8c3b-db45cd303860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.792500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5956-111b-438e-8c3b-db45cd303860 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.793195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c5956-111b-438e-8c3b-db45cd303860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:29.795091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c5956-111b-438e-8c3b-db45cd303860 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:29.819227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1138/2236] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:29 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:29.820901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57e05-fa9d-446c-b187-1b461495c787 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:29.831118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57e05-fa9d-446c-b187-1b461495c787 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:29.835772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290591c-3a7c-49de-a6e1-2ff060a77c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:29.836426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290591c-3a7c-49de-a6e1-2ff060a77c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.836734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290591c-3a7c-49de-a6e1-2ff060a77c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.837086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290591c-3a7c-49de-a6e1-2ff060a77c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.837792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290591c-3a7c-49de-a6e1-2ff060a77c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:29.839479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290591c-3a7c-49de-a6e1-2ff060a77c16 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:29.850641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1099/2237] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:29.855088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c5956-111b-438e-8c3b-db45cd303860 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:29.865031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c5956-111b-438e-8c3b-db45cd303860 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:29.870329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d015bb-6bcb-4ebe-8f3e-55cd509bbe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:29.870991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d015bb-6bcb-4ebe-8f3e-55cd509bbe25 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.871274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d015bb-6bcb-4ebe-8f3e-55cd509bbe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.871583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d015bb-6bcb-4ebe-8f3e-55cd509bbe25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.872315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d015bb-6bcb-4ebe-8f3e-55cd509bbe25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:29.873917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d015bb-6bcb-4ebe-8f3e-55cd509bbe25 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:29.884280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1139/2238] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:29.888210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290591c-3a7c-49de-a6e1-2ff060a77c16 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:29.898104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290591c-3a7c-49de-a6e1-2ff060a77c16 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:29.903437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb7cc3-d342-47f8-8fe2-1af7753fc269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:29.904312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7cc3-d342-47f8-8fe2-1af7753fc269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.904594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7cc3-d342-47f8-8fe2-1af7753fc269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.904868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7cc3-d342-47f8-8fe2-1af7753fc269 admin admin] PATH_INFO: `/v3/projects/85938ed463b24df5841af0bff116fbe2/users/aa5600e3d2f44146a08250904c156186/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.919941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb7cc3-d342-47f8-8fe2-1af7753fc269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85938ed463b24df5841af0bff116fbe2, user_id=aa5600e3d2f44146a08250904c156186, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:29.922584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb7cc3-d342-47f8-8fe2-1af7753fc269 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:29.935366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1100/2239] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:29 2022] PUT /identity/v3/projects/85938ed463b24df5841af0bff116fbe2/users/aa5600e3d2f44146a08250904c156186/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:29.946558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec0a6-a3e9-45aa-bd8c-9f853e52494e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:29.946852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec0a6-a3e9-45aa-bd8c-9f853e52494e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:29.947137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fec0a6-a3e9-45aa-bd8c-9f853e52494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:29.973847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f8fec0a6-a3e9-45aa-bd8c-9f853e52494e None None] MFA Rules not processed for user `aa5600e3d2f44146a08250904c156186`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:29.975055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f8fec0a6-a3e9-45aa-bd8c-9f853e52494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:30.041856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1140/2240] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:23:30.052792 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb7cc3-d342-47f8-8fe2-1af7753fc269 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:30.054469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-aeeb7cc3-d342-47f8-8fe2-1af7753fc269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:30.117006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb7cc3-d342-47f8-8fe2-1af7753fc269 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:30.123915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd126c5-2df2-40fc-8d10-561ca4280e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:30.124782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd126c5-2df2-40fc-8d10-561ca4280e0d service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:30.125170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd126c5-2df2-40fc-8d10-561ca4280e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:30.125460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd126c5-2df2-40fc-8d10-561ca4280e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:30.134447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd126c5-2df2-40fc-8d10-561ca4280e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:30.135862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd126c5-2df2-40fc-8d10-561ca4280e0d service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:30.145119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1101/2241] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:31.245528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fec0a6-a3e9-45aa-bd8c-9f853e52494e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:31.247014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f8fec0a6-a3e9-45aa-bd8c-9f853e52494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:31.267507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:31.313976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fec0a6-a3e9-45aa-bd8c-9f853e52494e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:31.318454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:31.319611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:31.319897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:31.320174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] PATH_INFO: `/v3/users/97f29cd4bbeb47f0bc8a7e6110245aeb` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:31.321557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f29cd4bbeb47f0bc8a7e6110245aeb)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:31.323687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:31.368467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f29cd4bbeb47f0bc8a7e6110245aeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:31.375211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f29cd4bbeb47f0bc8a7e6110245aeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:31.375940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f29cd4bbeb47f0bc8a7e6110245aeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:31.382778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f29cd4bbeb47f0bc8a7e6110245aeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:31.394349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f29cd4bbeb47f0bc8a7e6110245aeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:31.400681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1141/2242] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:31 2022] DELETE /identity/v3/users/97f29cd4bbeb47f0bc8a7e6110245aeb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:31.405289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6416-0a17-4a6b-8845-ac1d94ed3900 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:31.405759 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6416-0a17-4a6b-8845-ac1d94ed3900 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:31.405895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6416-0a17-4a6b-8845-ac1d94ed3900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:31.422903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1f9c6416-0a17-4a6b-8845-ac1d94ed3900 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:31.424145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1f9c6416-0a17-4a6b-8845-ac1d94ed3900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:31.446329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:31.508585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1102/2243] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:31.516059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:31.517504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:31.589088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98963a-255b-4da3-9f0d-0fb59647b92c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:31.593139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a69d72-4ae3-49d2-9955-f8e70a2f473d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:31.593793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69d72-4ae3-49d2-9955-f8e70a2f473d service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:31.594161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69d72-4ae3-49d2-9955-f8e70a2f473d service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:31.594452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a69d72-4ae3-49d2-9955-f8e70a2f473d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:31.615063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a69d72-4ae3-49d2-9955-f8e70a2f473d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:31.617675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a69d72-4ae3-49d2-9955-f8e70a2f473d service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:31.636135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1142/2244] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:31.908384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6416-0a17-4a6b-8845-ac1d94ed3900 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:31.909823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1f9c6416-0a17-4a6b-8845-ac1d94ed3900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:31.921938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6416-0a17-4a6b-8845-ac1d94ed3900 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:31.926675 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:31.927601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:31.927894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:31.928173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] PATH_INFO: `/v3/projects/a7d59515ba11404880ba037bdaa56b0d` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:31.929406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d59515ba11404880ba037bdaa56b0d)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:31.931317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:31.978478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d59515ba11404880ba037bdaa56b0d', 'request_id': 'req-860952d0-9bdc-4e20-925a-0fe99ff46959'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:31.984559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d59515ba11404880ba037bdaa56b0d', 'request_id': 'req-860952d0-9bdc-4e20-925a-0fe99ff46959'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:31.991982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d59515ba11404880ba037bdaa56b0d', 'request_id': 'req-860952d0-9bdc-4e20-925a-0fe99ff46959'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:32.002229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] The token cache is being invalidate because project a7d59515ba11404880ba037bdaa56b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:32.002538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:32.003174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-860952d0-9bdc-4e20-925a-0fe99ff46959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:32.004753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1103/2245] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:31 2022] DELETE /identity/v3/projects/a7d59515ba11404880ba037bdaa56b0d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:32.010165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e280ed-3cea-4096-b05d-0831fb89f48e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.010482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e280ed-3cea-4096-b05d-0831fb89f48e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.010761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e280ed-3cea-4096-b05d-0831fb89f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.028757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-77e280ed-3cea-4096-b05d-0831fb89f48e None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:32.029884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-77e280ed-3cea-4096-b05d-0831fb89f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:32.063657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:32.092729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1143/2246] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:32.100561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7b0bc-627b-4392-ac20-026c3705c76d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.100854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7b0bc-627b-4392-ac20-026c3705c76d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.101137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7b0bc-627b-4392-ac20-026c3705c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.119731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-70c7b0bc-627b-4392-ac20-026c3705c76d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:32.120930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-70c7b0bc-627b-4392-ac20-026c3705c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:32.128832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1104/2247] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:32.132989 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e280ed-3cea-4096-b05d-0831fb89f48e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:32.143153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e280ed-3cea-4096-b05d-0831fb89f48e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:32.147721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1121b-ce48-445a-b938-7f817f402664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:32.148365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1121b-ce48-445a-b938-7f817f402664 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.148645 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1121b-ce48-445a-b938-7f817f402664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.148920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1121b-ce48-445a-b938-7f817f402664 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.149649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1121b-ce48-445a-b938-7f817f402664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:32.149955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1121b-ce48-445a-b938-7f817f402664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:32.151571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1121b-ce48-445a-b938-7f817f402664 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:32.162799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1144/2248] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:32.166908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7b0bc-627b-4392-ac20-026c3705c76d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:32.176208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7b0bc-627b-4392-ac20-026c3705c76d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:32.181497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e88b4-508d-42a3-b7a8-d52a662a51e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:32.182151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e88b4-508d-42a3-b7a8-d52a662a51e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.182439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e88b4-508d-42a3-b7a8-d52a662a51e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.182717 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e88b4-508d-42a3-b7a8-d52a662a51e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.183451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e88b4-508d-42a3-b7a8-d52a662a51e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:32.185344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e88b4-508d-42a3-b7a8-d52a662a51e6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:32.211224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1105/2249] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:32 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:32.215425 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1121b-ce48-445a-b938-7f817f402664 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:32.225249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1121b-ce48-445a-b938-7f817f402664 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:32.280459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795d43a-6288-45c4-94c5-cd6a83dca0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:32.281116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795d43a-6288-45c4-94c5-cd6a83dca0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.281426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795d43a-6288-45c4-94c5-cd6a83dca0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.281701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795d43a-6288-45c4-94c5-cd6a83dca0ca admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.282389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795d43a-6288-45c4-94c5-cd6a83dca0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:32.284309 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795d43a-6288-45c4-94c5-cd6a83dca0ca admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:32.304794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1145/2250] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:32 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:32.309372 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e88b4-508d-42a3-b7a8-d52a662a51e6 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:32.319719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e88b4-508d-42a3-b7a8-d52a662a51e6 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:32.325776 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f73d33-8df2-4437-8654-578e0b6b0d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:32.326441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73d33-8df2-4437-8654-578e0b6b0d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.326720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73d33-8df2-4437-8654-578e0b6b0d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.326991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f73d33-8df2-4437-8654-578e0b6b0d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.327761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f73d33-8df2-4437-8654-578e0b6b0d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:32.329342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f73d33-8df2-4437-8654-578e0b6b0d42 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:32.340120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1106/2251] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:32.343980 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795d43a-6288-45c4-94c5-cd6a83dca0ca admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:32.354615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795d43a-6288-45c4-94c5-cd6a83dca0ca admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:32.359182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3095c-6f2e-4ecf-a10b-8179ae1f7b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:32.359874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3095c-6f2e-4ecf-a10b-8179ae1f7b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.360154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3095c-6f2e-4ecf-a10b-8179ae1f7b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.360427 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3095c-6f2e-4ecf-a10b-8179ae1f7b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.361151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3095c-6f2e-4ecf-a10b-8179ae1f7b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:32.362723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3095c-6f2e-4ecf-a10b-8179ae1f7b93 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:32.373385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1146/2252] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:32.377623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f73d33-8df2-4437-8654-578e0b6b0d42 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:32.388172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f73d33-8df2-4437-8654-578e0b6b0d42 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:32.393114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9633d2b-77ee-4e0b-b12a-e2f0992e6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:32.394000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9633d2b-77ee-4e0b-b12a-e2f0992e6641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.394286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9633d2b-77ee-4e0b-b12a-e2f0992e6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.394562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9633d2b-77ee-4e0b-b12a-e2f0992e6641 admin admin] PATH_INFO: `/v3/projects/27d99aa85f914d58aaa574aaa1ffa0cd/users/8e1fad8239d3450cad8ef929ebfb3ade/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.409442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9633d2b-77ee-4e0b-b12a-e2f0992e6641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d99aa85f914d58aaa574aaa1ffa0cd, user_id=8e1fad8239d3450cad8ef929ebfb3ade, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:32.412124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9633d2b-77ee-4e0b-b12a-e2f0992e6641 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:32.425310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1107/2253] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:32 2022] PUT /identity/v3/projects/27d99aa85f914d58aaa574aaa1ffa0cd/users/8e1fad8239d3450cad8ef929ebfb3ade/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:23:32.436209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401465ef-ac93-44ab-85bd-099d381b694c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.436629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401465ef-ac93-44ab-85bd-099d381b694c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.436827 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401465ef-ac93-44ab-85bd-099d381b694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.464638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-401465ef-ac93-44ab-85bd-099d381b694c None None] MFA Rules not processed for user `8e1fad8239d3450cad8ef929ebfb3ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:32.465848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-401465ef-ac93-44ab-85bd-099d381b694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:32.537016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1147/2254] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:23:32.549096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9633d2b-77ee-4e0b-b12a-e2f0992e6641 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:32.550793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c9633d2b-77ee-4e0b-b12a-e2f0992e6641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:32.601587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:32.608332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9633d2b-77ee-4e0b-b12a-e2f0992e6641 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:32.612955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b8de3-7e54-4865-8990-631e2bc26f93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:32.613618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b8de3-7e54-4865-8990-631e2bc26f93 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:32.613905 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b8de3-7e54-4865-8990-631e2bc26f93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:32.614185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b8de3-7e54-4865-8990-631e2bc26f93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:32.623169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b8de3-7e54-4865-8990-631e2bc26f93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:32.624638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b8de3-7e54-4865-8990-631e2bc26f93 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:32.633472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1108/2255] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:37.785761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401465ef-ac93-44ab-85bd-099d381b694c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:37.826023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:37.851978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401465ef-ac93-44ab-85bd-099d381b694c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:37.857924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:37.858972 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:37.859272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:37.859597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] PATH_INFO: `/v3/users/8e1fad8239d3450cad8ef929ebfb3ade` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:37.861103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1fad8239d3450cad8ef929ebfb3ade)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:37.863455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:37.916973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1fad8239d3450cad8ef929ebfb3ade'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:37.925262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1fad8239d3450cad8ef929ebfb3ade'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:37.926028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1fad8239d3450cad8ef929ebfb3ade'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:37.933935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1fad8239d3450cad8ef929ebfb3ade'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:37.946673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1fad8239d3450cad8ef929ebfb3ade'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:37.953007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1148/2256] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:37 2022] DELETE /identity/v3/users/8e1fad8239d3450cad8ef929ebfb3ade => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:37.957601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e907-d1ac-4d09-8dba-5efa3bf469d1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:37.958036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e907-d1ac-4d09-8dba-5efa3bf469d1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:37.958239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e907-d1ac-4d09-8dba-5efa3bf469d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:37.978780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-f214e907-d1ac-4d09-8dba-5efa3bf469d1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:37.982026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f214e907-d1ac-4d09-8dba-5efa3bf469d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:38.059704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1109/2257] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:38.069768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:38.071209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:38.130113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111e33-9430-4cf7-a00a-b525db906ca9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:38.134035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82904b5e-45dc-4577-8135-50af77ce5338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:38.134787 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82904b5e-45dc-4577-8135-50af77ce5338 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:38.135126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82904b5e-45dc-4577-8135-50af77ce5338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:38.135442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82904b5e-45dc-4577-8135-50af77ce5338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:38.145619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82904b5e-45dc-4577-8135-50af77ce5338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:38.147097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82904b5e-45dc-4577-8135-50af77ce5338 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:38.158457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1149/2258] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:38.515140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e907-d1ac-4d09-8dba-5efa3bf469d1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:38.516573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f214e907-d1ac-4d09-8dba-5efa3bf469d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:38.530101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e907-d1ac-4d09-8dba-5efa3bf469d1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:38.537926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:38.539473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:38.539975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:38.540489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] PATH_INFO: `/v3/projects/27d99aa85f914d58aaa574aaa1ffa0cd` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:38.542624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d99aa85f914d58aaa574aaa1ffa0cd)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:38.546453 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:38.595674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d99aa85f914d58aaa574aaa1ffa0cd', 'request_id': 'req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:38.601713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d99aa85f914d58aaa574aaa1ffa0cd', 'request_id': 'req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:38.608505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d99aa85f914d58aaa574aaa1ffa0cd', 'request_id': 'req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:38.618836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] The token cache is being invalidate because project 27d99aa85f914d58aaa574aaa1ffa0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:38.619117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:38.619748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2b15e0e7-a2ef-42d5-80f7-289d2dfae546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:38.621284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1110/2259] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:38 2022] DELETE /identity/v3/projects/27d99aa85f914d58aaa574aaa1ffa0cd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:38.626170 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dc0d0-eeb4-4bd0-ad2b-6daee2dddb87 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:38.626491 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dc0d0-eeb4-4bd0-ad2b-6daee2dddb87 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:38.626776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dc0d0-eeb4-4bd0-ad2b-6daee2dddb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:38.644445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b13dc0d0-eeb4-4bd0-ad2b-6daee2dddb87 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:38.645650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b13dc0d0-eeb4-4bd0-ad2b-6daee2dddb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:38.694076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:38.705300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1150/2260] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:38.714302 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c0f86-6fe0-4e94-88ae-09e9b2db55b4 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:38.714578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c0f86-6fe0-4e94-88ae-09e9b2db55b4 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:38.714859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c0f86-6fe0-4e94-88ae-09e9b2db55b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:38.732852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d00c0f86-6fe0-4e94-88ae-09e9b2db55b4 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:38.734042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d00c0f86-6fe0-4e94-88ae-09e9b2db55b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:38.741931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1111/2261] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:38.745957 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dc0d0-eeb4-4bd0-ad2b-6daee2dddb87 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:38.755495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dc0d0-eeb4-4bd0-ad2b-6daee2dddb87 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:38.760742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5270a-3c3f-4b93-b017-bd946d0912e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:38.761384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5270a-3c3f-4b93-b017-bd946d0912e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:38.761664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5270a-3c3f-4b93-b017-bd946d0912e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:38.761940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5270a-3c3f-4b93-b017-bd946d0912e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:38.762668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5270a-3c3f-4b93-b017-bd946d0912e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:38.762974 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5270a-3c3f-4b93-b017-bd946d0912e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:38.764585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5270a-3c3f-4b93-b017-bd946d0912e7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:38.779443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1151/2262] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:38.781134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c0f86-6fe0-4e94-88ae-09e9b2db55b4 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:38.790547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c0f86-6fe0-4e94-88ae-09e9b2db55b4 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:38.795535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84025aa-f554-4dae-be2f-b62dfa6e0eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:38.796197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84025aa-f554-4dae-be2f-b62dfa6e0eab admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:38.796482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84025aa-f554-4dae-be2f-b62dfa6e0eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:38.796756 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84025aa-f554-4dae-be2f-b62dfa6e0eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:38.797458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84025aa-f554-4dae-be2f-b62dfa6e0eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:38.799464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84025aa-f554-4dae-be2f-b62dfa6e0eab admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:38.827003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1112/2263] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:38 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:38.831248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5270a-3c3f-4b93-b017-bd946d0912e7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:38.841918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5270a-3c3f-4b93-b017-bd946d0912e7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:38.900665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2a2ad-10f2-46e4-84ea-366967a60df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:38.901355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2a2ad-10f2-46e4-84ea-366967a60df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:38.901641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2a2ad-10f2-46e4-84ea-366967a60df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:38.901920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2a2ad-10f2-46e4-84ea-366967a60df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:38.902606 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2a2ad-10f2-46e4-84ea-366967a60df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:38.904710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2a2ad-10f2-46e4-84ea-366967a60df3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:38.924405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1152/2264] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:38 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:38.928601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84025aa-f554-4dae-be2f-b62dfa6e0eab admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:38.939580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84025aa-f554-4dae-be2f-b62dfa6e0eab admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:38.944430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53140176-0337-4942-a9fd-c25954ad7bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:38.945086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53140176-0337-4942-a9fd-c25954ad7bca admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:38.945375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53140176-0337-4942-a9fd-c25954ad7bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:38.945653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53140176-0337-4942-a9fd-c25954ad7bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:38.947055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53140176-0337-4942-a9fd-c25954ad7bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:38.948808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53140176-0337-4942-a9fd-c25954ad7bca admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:38.961160 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1113/2265] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:38.965187 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2a2ad-10f2-46e4-84ea-366967a60df3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:38.975135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2a2ad-10f2-46e4-84ea-366967a60df3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:38.980228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5c01a-7e2f-40cc-bcb1-ce577dc16473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:38.980880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5c01a-7e2f-40cc-bcb1-ce577dc16473 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:38.981161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5c01a-7e2f-40cc-bcb1-ce577dc16473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:38.981434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5c01a-7e2f-40cc-bcb1-ce577dc16473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:38.982155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5c01a-7e2f-40cc-bcb1-ce577dc16473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:38.983825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5c01a-7e2f-40cc-bcb1-ce577dc16473 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:38.995577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1153/2266] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:38.999785 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53140176-0337-4942-a9fd-c25954ad7bca admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:39.010649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53140176-0337-4942-a9fd-c25954ad7bca admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:39.015744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6fdcb-4df4-4621-bb9e-9bc08f6d1829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:39.016644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6fdcb-4df4-4621-bb9e-9bc08f6d1829 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:39.016934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6fdcb-4df4-4621-bb9e-9bc08f6d1829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:39.017208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6fdcb-4df4-4621-bb9e-9bc08f6d1829 admin admin] PATH_INFO: `/v3/projects/beb4ec35ffe94dfe8974f9f0aa474c11/users/5a8f90dff27d4c04988c3474e3a5532f/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:39.034448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6fdcb-4df4-4621-bb9e-9bc08f6d1829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb4ec35ffe94dfe8974f9f0aa474c11, user_id=5a8f90dff27d4c04988c3474e3a5532f, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:39.037142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6fdcb-4df4-4621-bb9e-9bc08f6d1829 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:39.057129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1114/2267] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:38 2022] PUT /identity/v3/projects/beb4ec35ffe94dfe8974f9f0aa474c11/users/5a8f90dff27d4c04988c3474e3a5532f/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:39.062415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f79fd-0370-42b2-bf28-651a506c7cb2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:39.062710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f79fd-0370-42b2-bf28-651a506c7cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:39.062991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f79fd-0370-42b2-bf28-651a506c7cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:39.081964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bf7f79fd-0370-42b2-bf28-651a506c7cb2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:39.083255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bf7f79fd-0370-42b2-bf28-651a506c7cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:39.144877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1154/2268] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:39.154867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6fdcb-4df4-4621-bb9e-9bc08f6d1829 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:39.157540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-cbd6fdcb-4df4-4621-bb9e-9bc08f6d1829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:39.168953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:39.222203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6fdcb-4df4-4621-bb9e-9bc08f6d1829 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:39.226009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeca59c-c0d9-4eae-aff4-3b9439ff4ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:39.226664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeca59c-c0d9-4eae-aff4-3b9439ff4ceb service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:39.226951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeca59c-c0d9-4eae-aff4-3b9439ff4ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:39.227234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeca59c-c0d9-4eae-aff4-3b9439ff4ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:39.237489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeca59c-c0d9-4eae-aff4-3b9439ff4ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:39.239038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeca59c-c0d9-4eae-aff4-3b9439ff4ceb service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:39.249084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1115/2269] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:23:39.933189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f79fd-0370-42b2-bf28-651a506c7cb2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:39.934871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bf7f79fd-0370-42b2-bf28-651a506c7cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:39.949091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f79fd-0370-42b2-bf28-651a506c7cb2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:39.956483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:39.957378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:39.957665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:39.957937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] PATH_INFO: `/v3/users/102ab6cae0d14675ad3dd3bff9e9aab8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:39.959236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102ab6cae0d14675ad3dd3bff9e9aab8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:39.962386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:40.021646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102ab6cae0d14675ad3dd3bff9e9aab8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.035655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102ab6cae0d14675ad3dd3bff9e9aab8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.036860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102ab6cae0d14675ad3dd3bff9e9aab8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.040455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:40.049532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102ab6cae0d14675ad3dd3bff9e9aab8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.067172 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102ab6cae0d14675ad3dd3bff9e9aab8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.077587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1155/2270] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:39 2022] DELETE /identity/v3/users/102ab6cae0d14675ad3dd3bff9e9aab8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:40.079442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106444a-7988-494f-9efb-489116c688ae None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:40.079897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106444a-7988-494f-9efb-489116c688ae None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:40.080132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106444a-7988-494f-9efb-489116c688ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:40.098906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7106444a-7988-494f-9efb-489116c688ae None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:40.100263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7106444a-7988-494f-9efb-489116c688ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:40.169329 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1116/2271] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:40.182663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:40.184201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:40.257749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138cb30-3084-42f7-b78c-83672f4d7f10 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:40.262247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44384b4b-7b02-42d0-9c38-22548f0fc2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:40.262923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44384b4b-7b02-42d0-9c38-22548f0fc2dc service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:40.263297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44384b4b-7b02-42d0-9c38-22548f0fc2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:40.263677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44384b4b-7b02-42d0-9c38-22548f0fc2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:40.274984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44384b4b-7b02-42d0-9c38-22548f0fc2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:40.276679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44384b4b-7b02-42d0-9c38-22548f0fc2dc service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:40.287853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1156/2272] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:40.647957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106444a-7988-494f-9efb-489116c688ae None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:40.653304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7106444a-7988-494f-9efb-489116c688ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:40.676961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106444a-7988-494f-9efb-489116c688ae None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:40.683732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:40.692582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:40.692950 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:40.693283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] PATH_INFO: `/v3/projects/ccb8cecc17c14176808ef6ad15cb6768` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:40.695733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb8cecc17c14176808ef6ad15cb6768)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:40.699625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:40.765422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb8cecc17c14176808ef6ad15cb6768', 'request_id': 'req-01c0db44-fa12-40b6-891c-b7672a333cc7'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.771232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb8cecc17c14176808ef6ad15cb6768', 'request_id': 'req-01c0db44-fa12-40b6-891c-b7672a333cc7'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.784447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb8cecc17c14176808ef6ad15cb6768', 'request_id': 'req-01c0db44-fa12-40b6-891c-b7672a333cc7'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.803182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] The token cache is being invalidate because project ccb8cecc17c14176808ef6ad15cb6768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:40.803943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.804504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-01c0db44-fa12-40b6-891c-b7672a333cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:40.806533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1117/2273] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:40 2022] DELETE /identity/v3/projects/ccb8cecc17c14176808ef6ad15cb6768 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:40.811222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2b1b3-763e-4fc1-9244-9c16913be9d7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:40.811641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2b1b3-763e-4fc1-9244-9c16913be9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:40.811818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2b1b3-763e-4fc1-9244-9c16913be9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:40.835145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d9d2b1b3-763e-4fc1-9244-9c16913be9d7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:40.836579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d9d2b1b3-763e-4fc1-9244-9c16913be9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:40.927457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1157/2274] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:40.990827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29397a0-36d4-4093-b516-2b5924cdbef1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:40.991474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29397a0-36d4-4093-b516-2b5924cdbef1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:40.991865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29397a0-36d4-4093-b516-2b5924cdbef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.019996 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e29397a0-36d4-4093-b516-2b5924cdbef1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:41.021478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e29397a0-36d4-4093-b516-2b5924cdbef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:41.031403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1118/2275] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:41.034570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2b1b3-763e-4fc1-9244-9c16913be9d7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:41.046872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2b1b3-763e-4fc1-9244-9c16913be9d7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:41.053649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b6434-ba71-4c8e-8dc6-d57369c68b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:41.054553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b6434-ba71-4c8e-8dc6-d57369c68b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.054988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b6434-ba71-4c8e-8dc6-d57369c68b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.055528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b6434-ba71-4c8e-8dc6-d57369c68b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.057111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b6434-ba71-4c8e-8dc6-d57369c68b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:23:41.057569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b6434-ba71-4c8e-8dc6-d57369c68b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:41.059605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b6434-ba71-4c8e-8dc6-d57369c68b1b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:41.076728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1158/2276] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:23:41.080814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29397a0-36d4-4093-b516-2b5924cdbef1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:41.097637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29397a0-36d4-4093-b516-2b5924cdbef1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:41.113801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814508f7-e239-43c9-9a2b-48031bb15f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:41.115603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814508f7-e239-43c9-9a2b-48031bb15f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.116056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814508f7-e239-43c9-9a2b-48031bb15f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.116661 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814508f7-e239-43c9-9a2b-48031bb15f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.117508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814508f7-e239-43c9-9a2b-48031bb15f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:41.120214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814508f7-e239-43c9-9a2b-48031bb15f7d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:41.169443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1119/2277] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:41 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:41.170222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b6434-ba71-4c8e-8dc6-d57369c68b1b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:41.199635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b6434-ba71-4c8e-8dc6-d57369c68b1b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:41.333157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c46f1-49a2-4a7b-8ce3-575656584d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:41.334074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c46f1-49a2-4a7b-8ce3-575656584d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.334473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c46f1-49a2-4a7b-8ce3-575656584d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.334888 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c46f1-49a2-4a7b-8ce3-575656584d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.335664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c46f1-49a2-4a7b-8ce3-575656584d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:41.339203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c46f1-49a2-4a7b-8ce3-575656584d52 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:41.376961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:41.394203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1159/2278] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:41 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:41.398738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814508f7-e239-43c9-9a2b-48031bb15f7d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:41.411533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814508f7-e239-43c9-9a2b-48031bb15f7d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:41.417173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5489f-009a-4a80-9d29-aa4c58446949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:41.418132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5489f-009a-4a80-9d29-aa4c58446949 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.418569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5489f-009a-4a80-9d29-aa4c58446949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.419103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5489f-009a-4a80-9d29-aa4c58446949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.420067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5489f-009a-4a80-9d29-aa4c58446949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:41.428048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5489f-009a-4a80-9d29-aa4c58446949 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:41.429873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:41.442611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1120/2279] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:41.447446 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c46f1-49a2-4a7b-8ce3-575656584d52 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:41.458032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c46f1-49a2-4a7b-8ce3-575656584d52 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:41.462974 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbcb3d-15b7-449c-8af5-b3e8fffc2b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:41.463804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbcb3d-15b7-449c-8af5-b3e8fffc2b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.464091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbcb3d-15b7-449c-8af5-b3e8fffc2b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.464369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbcb3d-15b7-449c-8af5-b3e8fffc2b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.465102 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbcb3d-15b7-449c-8af5-b3e8fffc2b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:41.466684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbcb3d-15b7-449c-8af5-b3e8fffc2b93 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:41.477923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1160/2280] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:41.482045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5489f-009a-4a80-9d29-aa4c58446949 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:41.493939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5489f-009a-4a80-9d29-aa4c58446949 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:41.499266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f5fc3-9c5d-4acd-9bc5-fd3a76a4caab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:41.500187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f5fc3-9c5d-4acd-9bc5-fd3a76a4caab admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.500463 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f5fc3-9c5d-4acd-9bc5-fd3a76a4caab admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.500730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f5fc3-9c5d-4acd-9bc5-fd3a76a4caab admin admin] PATH_INFO: `/v3/projects/d31bbbedbdfa49d89f7fbac1e7a1568f/users/50a0a0568778463b897bf8649f191526/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.517144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f5fc3-9c5d-4acd-9bc5-fd3a76a4caab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31bbbedbdfa49d89f7fbac1e7a1568f, user_id=50a0a0568778463b897bf8649f191526, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:41.519981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f5fc3-9c5d-4acd-9bc5-fd3a76a4caab admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:41.533582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1121/2281] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:41 2022] PUT /identity/v3/projects/d31bbbedbdfa49d89f7fbac1e7a1568f/users/50a0a0568778463b897bf8649f191526/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:41.544016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699613-6ee4-4f2f-9964-4a934d388b92 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.544389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699613-6ee4-4f2f-9964-4a934d388b92 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.544821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699613-6ee4-4f2f-9964-4a934d388b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.586538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f4699613-6ee4-4f2f-9964-4a934d388b92 None None] MFA Rules not processed for user `50a0a0568778463b897bf8649f191526`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:41.588042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f4699613-6ee4-4f2f-9964-4a934d388b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:41.690241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f5fc3-9c5d-4acd-9bc5-fd3a76a4caab admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:41.691300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1161/2282] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:41.692603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-fb1f5fc3-9c5d-4acd-9bc5-fd3a76a4caab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:41.704141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4699613-6ee4-4f2f-9964-4a934d388b92 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:41.706825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f4699613-6ee4-4f2f-9964-4a934d388b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:41.773149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f5fc3-9c5d-4acd-9bc5-fd3a76a4caab admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:41.778663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:41.779760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.780362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.780641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] PATH_INFO: `/v3/users/aa5600e3d2f44146a08250904c156186` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.782132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5600e3d2f44146a08250904c156186)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:41.785485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:41.786799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4699613-6ee4-4f2f-9964-4a934d388b92 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:41.793265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19a462-19de-41c1-9db0-a7fae79a102b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:41.795057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19a462-19de-41c1-9db0-a7fae79a102b service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.795445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19a462-19de-41c1-9db0-a7fae79a102b service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.797068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19a462-19de-41c1-9db0-a7fae79a102b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.807608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19a462-19de-41c1-9db0-a7fae79a102b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:41.809179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19a462-19de-41c1-9db0-a7fae79a102b service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:41.820310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1162/2283] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:41.851124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19a462-19de-41c1-9db0-a7fae79a102b service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:41.874254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5600e3d2f44146a08250904c156186'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:41.876337 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19a462-19de-41c1-9db0-a7fae79a102b service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:41.878365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5600e3d2f44146a08250904c156186'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:41.887288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5600e3d2f44146a08250904c156186'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:41.888431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5600e3d2f44146a08250904c156186'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:41.901815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1e486438-afec-414c-b3f9-d0f154151638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5600e3d2f44146a08250904c156186'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:41.905772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:41.906674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.906960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.907242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] PATH_INFO: `/v3/users/50a0a0568778463b897bf8649f191526` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.908671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a0a0568778463b897bf8649f191526)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:41.910795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:41.929013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1122/2284] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:41 2022] DELETE /identity/v3/users/aa5600e3d2f44146a08250904c156186 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:41.931260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce35a2-7a4b-4a41-9549-09695424605f None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:41.931667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce35a2-7a4b-4a41-9549-09695424605f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:41.932003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce35a2-7a4b-4a41-9549-09695424605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:41.953481 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-abce35a2-7a4b-4a41-9549-09695424605f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:41.954317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-abce35a2-7a4b-4a41-9549-09695424605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:42.020283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:42.031310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a0a0568778463b897bf8649f191526'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:42.043545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1123/2285] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:42.047254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a0a0568778463b897bf8649f191526'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:42.048095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a0a0568778463b897bf8649f191526'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:42.062593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a0a0568778463b897bf8649f191526'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:42.072653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:42.079854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2d85f660-9029-40ab-a16c-508bdde638f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a0a0568778463b897bf8649f191526'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:42.087118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce35a2-7a4b-4a41-9549-09695424605f None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:42.088577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-abce35a2-7a4b-4a41-9549-09695424605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:42.089432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1163/2286] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:23:41 2022] DELETE /identity/v3/users/50a0a0568778463b897bf8649f191526 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:42.093778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a84d42-f8d2-4181-b32f-e38c0ae28fca None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:42.094068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a84d42-f8d2-4181-b32f-e38c0ae28fca None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:42.094575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a84d42-f8d2-4181-b32f-e38c0ae28fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:42.127713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-85a84d42-f8d2-4181-b32f-e38c0ae28fca None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:42.128958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-85a84d42-f8d2-4181-b32f-e38c0ae28fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:42.197454 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce35a2-7a4b-4a41-9549-09695424605f None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:42.272320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1164/2287] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:23:42.282489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:42.283263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:42.283581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a84d42-f8d2-4181-b32f-e38c0ae28fca None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:42.283761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:42.284244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:42.285133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-85a84d42-f8d2-4181-b32f-e38c0ae28fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:42.286254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:42.297404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a84d42-f8d2-4181-b32f-e38c0ae28fca None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:42.299179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:42.301768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8ca55-25c4-4ae5-b716-514b63266e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:42.301881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:42.302524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8ca55-25c4-4ae5-b716-514b63266e24 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:42.302893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8ca55-25c4-4ae5-b716-514b63266e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:42.303244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8ca55-25c4-4ae5-b716-514b63266e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:42.314730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1124/2288] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:23:42.340740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8ca55-25c4-4ae5-b716-514b63266e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:42.342221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8ca55-25c4-4ae5-b716-514b63266e24 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:42.362305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1165/2289] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:43.191680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:43.194461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:43.228748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d4e44-7f76-40a9-ace3-8fc4b6459e00 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:43.243690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:43.245052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:43.245341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:43.245645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] PATH_INFO: `/v3/projects/85938ed463b24df5841af0bff116fbe2` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:43.251616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] RBAC: Authorizing `identity:delete_project(project_id=85938ed463b24df5841af0bff116fbe2)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:43.254940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:43.265479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8ca55-25c4-4ae5-b716-514b63266e24 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:43.267582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-92d8ca55-25c4-4ae5-b716-514b63266e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:43.316503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8ca55-25c4-4ae5-b716-514b63266e24 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:43.350008 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:43.352848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:43.353630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:43.356546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] PATH_INFO: `/v3/projects/d31bbbedbdfa49d89f7fbac1e7a1568f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:43.360212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31bbbedbdfa49d89f7fbac1e7a1568f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:43.365659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:43.471495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85938ed463b24df5841af0bff116fbe2', 'request_id': 'req-c8cd342c-05bc-43a4-8e02-082d8280866b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.491869 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85938ed463b24df5841af0bff116fbe2', 'request_id': 'req-c8cd342c-05bc-43a4-8e02-082d8280866b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.524714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31bbbedbdfa49d89f7fbac1e7a1568f', 'request_id': 'req-5a122b81-76fe-4079-a0b1-07ba6ef95765'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.524924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85938ed463b24df5841af0bff116fbe2', 'request_id': 'req-c8cd342c-05bc-43a4-8e02-082d8280866b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.538246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] The token cache is being invalidate because project 85938ed463b24df5841af0bff116fbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:43.539100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.540698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c8cd342c-05bc-43a4-8e02-082d8280866b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.543254 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31bbbedbdfa49d89f7fbac1e7a1568f', 'request_id': 'req-5a122b81-76fe-4079-a0b1-07ba6ef95765'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.565408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1125/2290] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:43 2022] DELETE /identity/v3/projects/85938ed463b24df5841af0bff116fbe2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:43.565528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31bbbedbdfa49d89f7fbac1e7a1568f', 'request_id': 'req-5a122b81-76fe-4079-a0b1-07ba6ef95765'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.574036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] The token cache is being invalidate because project d31bbbedbdfa49d89f7fbac1e7a1568f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:23:43.575467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.578585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:23:43.615265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1166/2291] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:23:43 2022] DELETE /identity/v3/projects/d31bbbedbdfa49d89f7fbac1e7a1568f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:45.829877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f597d-1853-4f6a-b212-5a594810f88d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:45.830356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f597d-1853-4f6a-b212-5a594810f88d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:45.830466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f597d-1853-4f6a-b212-5a594810f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:45.858943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-905f597d-1853-4f6a-b212-5a594810f88d None None] MFA Rules not processed for user `5a8f90dff27d4c04988c3474e3a5532f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:45.860190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-905f597d-1853-4f6a-b212-5a594810f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:45.879817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:45.928754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1126/2292] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:45.933550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:45.935021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:46.000145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a122b81-76fe-4079-a0b1-07ba6ef95765 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:46.004695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859202b-9387-4469-ba81-f517174c160d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:46.005353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859202b-9387-4469-ba81-f517174c160d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:46.005635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859202b-9387-4469-ba81-f517174c160d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:46.005911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859202b-9387-4469-ba81-f517174c160d admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:46.006596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859202b-9387-4469-ba81-f517174c160d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:46.009436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859202b-9387-4469-ba81-f517174c160d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:46.021840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:46.048410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1167/2293] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:23:45 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:23:46.052398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f597d-1853-4f6a-b212-5a594810f88d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:46.063386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f597d-1853-4f6a-b212-5a594810f88d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:46.120399 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23943f8-25aa-4551-b733-ef170bc982fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:46.120994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23943f8-25aa-4551-b733-ef170bc982fd admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:46.121281 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23943f8-25aa-4551-b733-ef170bc982fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:46.121559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23943f8-25aa-4551-b733-ef170bc982fd admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:46.122263 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23943f8-25aa-4551-b733-ef170bc982fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:46.124241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23943f8-25aa-4551-b733-ef170bc982fd admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:46.148608 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1127/2294] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:23:46 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:23:46.150338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859202b-9387-4469-ba81-f517174c160d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:46.161093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859202b-9387-4469-ba81-f517174c160d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:46.165704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c18f-07d6-421f-ab08-b6f6c41911b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:46.166370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c18f-07d6-421f-ab08-b6f6c41911b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:46.166653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c18f-07d6-421f-ab08-b6f6c41911b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:46.166933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c18f-07d6-421f-ab08-b6f6c41911b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:46.167852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c18f-07d6-421f-ab08-b6f6c41911b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:46.169444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c18f-07d6-421f-ab08-b6f6c41911b5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:46.182739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1168/2295] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:46.183879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23943f8-25aa-4551-b733-ef170bc982fd admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:46.194307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23943f8-25aa-4551-b733-ef170bc982fd admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:46.200328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec798b-e6b0-47f0-ae4b-cd3b8e7af320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:46.201475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec798b-e6b0-47f0-ae4b-cd3b8e7af320 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:46.201815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec798b-e6b0-47f0-ae4b-cd3b8e7af320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:46.202098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec798b-e6b0-47f0-ae4b-cd3b8e7af320 admin admin] PATH_INFO: `/v3/projects/257d601f3a654a2598498470efe63c3c/users/2b4cf7d8c73a4372a1bb1c8506da8d71/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:46.218924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec798b-e6b0-47f0-ae4b-cd3b8e7af320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257d601f3a654a2598498470efe63c3c, user_id=2b4cf7d8c73a4372a1bb1c8506da8d71, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:46.221706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec798b-e6b0-47f0-ae4b-cd3b8e7af320 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:46.234495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1128/2296] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:46 2022] PUT /identity/v3/projects/257d601f3a654a2598498470efe63c3c/users/2b4cf7d8c73a4372a1bb1c8506da8d71/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:46.238489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c18f-07d6-421f-ab08-b6f6c41911b5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:46.249812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c18f-07d6-421f-ab08-b6f6c41911b5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:46.307575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa08a-ced0-4f41-ac9a-99ffccae7ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:46.308349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa08a-ced0-4f41-ac9a-99ffccae7ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:46.308757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa08a-ced0-4f41-ac9a-99ffccae7ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:46.309046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa08a-ced0-4f41-ac9a-99ffccae7ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:46.309787 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efa08a-ced0-4f41-ac9a-99ffccae7ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:46.311422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efa08a-ced0-4f41-ac9a-99ffccae7ffb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:46.322800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1169/2297] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:23:46.326794 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec798b-e6b0-47f0-ae4b-cd3b8e7af320 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:46.338734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec798b-e6b0-47f0-ae4b-cd3b8e7af320 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:46.343524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080231df-2e1f-4f20-a228-f609b9a6e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:46.344411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080231df-2e1f-4f20-a228-f609b9a6e609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:46.344695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080231df-2e1f-4f20-a228-f609b9a6e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:46.344968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080231df-2e1f-4f20-a228-f609b9a6e609 admin admin] PATH_INFO: `/v3/projects/257d601f3a654a2598498470efe63c3c/users/2b4cf7d8c73a4372a1bb1c8506da8d71/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:46.347001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080231df-2e1f-4f20-a228-f609b9a6e609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257d601f3a654a2598498470efe63c3c, user_id=2b4cf7d8c73a4372a1bb1c8506da8d71, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:46.349665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080231df-2e1f-4f20-a228-f609b9a6e609 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:46.360431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1129/2298] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:23:46 2022] PUT /identity/v3/projects/257d601f3a654a2598498470efe63c3c/users/2b4cf7d8c73a4372a1bb1c8506da8d71/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:23:51.960534 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94caf-ec9a-44a8-905b-4956fc82a7d3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:51.961307 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94caf-ec9a-44a8-905b-4956fc82a7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:51.961307 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94caf-ec9a-44a8-905b-4956fc82a7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:51.986473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-00c94caf-ec9a-44a8-905b-4956fc82a7d3 None None] MFA Rules not processed for user `79b17e95e5f0434b854b196dee43154c`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:51.987821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-00c94caf-ec9a-44a8-905b-4956fc82a7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:52.074901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1170/2299] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:52.076557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333c9d9-1a5b-4942-ab53-5517f0138460 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:52.077040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333c9d9-1a5b-4942-ab53-5517f0138460 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:52.077134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333c9d9-1a5b-4942-ab53-5517f0138460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:52.143324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a333c9d9-1a5b-4942-ab53-5517f0138460 None None] MFA Rules not processed for user `2b4cf7d8c73a4372a1bb1c8506da8d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:52.148399 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a333c9d9-1a5b-4942-ab53-5517f0138460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:52.241406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:52.252067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1130/2300] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:23:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:52.262543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94caf-ec9a-44a8-905b-4956fc82a7d3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:52.264025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-00c94caf-ec9a-44a8-905b-4956fc82a7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:52.332595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94caf-ec9a-44a8-905b-4956fc82a7d3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:52.337131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5e5d-f91e-483e-8627-64fee0bb8d02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a418c5817e784d299c8d6daad20c6cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:52.337868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5e5d-f91e-483e-8627-64fee0bb8d02 service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:52.338228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5e5d-f91e-483e-8627-64fee0bb8d02 service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:52.338507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c5e5d-f91e-483e-8627-64fee0bb8d02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:52.375757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:23:52.416291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c5e5d-f91e-483e-8627-64fee0bb8d02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:52.417192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c5e5d-f91e-483e-8627-64fee0bb8d02 service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:52.427193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1171/2301] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:23:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:23:52.535791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354c90-ea6b-4f2f-8832-3dcd30eeff70 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:52.536083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354c90-ea6b-4f2f-8832-3dcd30eeff70 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:52.536367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9354c90-ea6b-4f2f-8832-3dcd30eeff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:52.554528 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b9354c90-ea6b-4f2f-8832-3dcd30eeff70 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:23:52.556306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b9354c90-ea6b-4f2f-8832-3dcd30eeff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:52.614408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1131/2302] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:23:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:23:52.659237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5e5d-f91e-483e-8627-64fee0bb8d02 service glance] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:23:52.661862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f05c5e5d-f91e-483e-8627-64fee0bb8d02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:23:52.733604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c5e5d-f91e-483e-8627-64fee0bb8d02 service glance] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:23:52.738731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eb797-401a-4e08-9f82-778a0cc6d18d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:23:52.739494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb797-401a-4e08-9f82-778a0cc6d18d service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:23:52.739858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb797-401a-4e08-9f82-778a0cc6d18d service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:23:52.740222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eb797-401a-4e08-9f82-778a0cc6d18d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:23:52.750672 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eb797-401a-4e08-9f82-778a0cc6d18d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:23:52.752446 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eb797-401a-4e08-9f82-778a0cc6d18d service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:23:52.764202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1172/2303] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:23:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:24:02.607116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=25 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:02.760550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=46 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:03.570556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669dc15-3cf2-4a0e-bc41-62987f09a01c None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:03.570846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669dc15-3cf2-4a0e-bc41-62987f09a01c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:03.571122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669dc15-3cf2-4a0e-bc41-62987f09a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:03.601773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-3669dc15-3cf2-4a0e-bc41-62987f09a01c None None] MFA Rules not processed for user `5a8f90dff27d4c04988c3474e3a5532f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:03.603092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3669dc15-3cf2-4a0e-bc41-62987f09a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:03.631700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1132/2304] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:24:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:24:03.694725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253afa30-cc1b-416d-b781-c3e6135df017 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:03.694850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253afa30-cc1b-416d-b781-c3e6135df017 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:03.695108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253afa30-cc1b-416d-b781-c3e6135df017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:03.713526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-253afa30-cc1b-416d-b781-c3e6135df017 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:03.714770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-253afa30-cc1b-416d-b781-c3e6135df017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:03.740565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1173/2305] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:24:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:24:03.752987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669dc15-3cf2-4a0e-bc41-62987f09a01c None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:03.778382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669dc15-3cf2-4a0e-bc41-62987f09a01c None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:03.789462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c1e2-824f-429d-b3d3-0c64e3e457ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:03.790125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c1e2-824f-429d-b3d3-0c64e3e457ed service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:03.790408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c1e2-824f-429d-b3d3-0c64e3e457ed service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:03.791448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c1e2-824f-429d-b3d3-0c64e3e457ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:03.802645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c1e2-824f-429d-b3d3-0c64e3e457ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:03.804653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c1e2-824f-429d-b3d3-0c64e3e457ed service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:03.820256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1133/2306] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:24:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:24:06.291806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e683-4e2f-4dff-a74e-af891f4bcad6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:06.292425 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e683-4e2f-4dff-a74e-af891f4bcad6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:06.292516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e683-4e2f-4dff-a74e-af891f4bcad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:06.328489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-74a8e683-4e2f-4dff-a74e-af891f4bcad6 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:06.337896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-74a8e683-4e2f-4dff-a74e-af891f4bcad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:06.394469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1174/2307] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:24:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:24:06.436567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c1e2-824f-429d-b3d3-0c64e3e457ed service swift] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:06.450256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c1e2-824f-429d-b3d3-0c64e3e457ed service swift] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:06.467959 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aac775-4efd-4176-bb0e-1c26acc466e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:06.468931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aac775-4efd-4176-bb0e-1c26acc466e6 service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:06.470570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aac775-4efd-4176-bb0e-1c26acc466e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:06.470570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aac775-4efd-4176-bb0e-1c26acc466e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:06.501590 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aac775-4efd-4176-bb0e-1c26acc466e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:06.505095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aac775-4efd-4176-bb0e-1c26acc466e6 service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:06.527318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1134/2308] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:24:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:24:16.353039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=13 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:16.518364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=30 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:23.292971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09027d-6eb4-4af2-af9a-fa227f4270a0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:23.293546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09027d-6eb4-4af2-af9a-fa227f4270a0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:23.293546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09027d-6eb4-4af2-af9a-fa227f4270a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:23.311504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ca09027d-6eb4-4af2-af9a-fa227f4270a0 None None] MFA Rules not processed for user `05ba6d637a31453b88ba4c18b47697b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:23.312733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ca09027d-6eb4-4af2-af9a-fa227f4270a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:23.367846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1175/2309] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:24:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:24:24.468610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643c84-a060-4bb2-af5a-d7e63e7ce6bb None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:24.469208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643c84-a060-4bb2-af5a-d7e63e7ce6bb None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:24.469208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643c84-a060-4bb2-af5a-d7e63e7ce6bb None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:24.470547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1135/2310] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:24.477390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926de8f-e776-428b-ba24-60c2743dc1da None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:24.477819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926de8f-e776-428b-ba24-60c2743dc1da None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:24.477940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926de8f-e776-428b-ba24-60c2743dc1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:24.559046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d926de8f-e776-428b-ba24-60c2743dc1da None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:24.560754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d926de8f-e776-428b-ba24-60c2743dc1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:24.660265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1176/2311] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:24:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:24:24.671768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643c84-a060-4bb2-af5a-d7e63e7ce6bb None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:24.683931 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643c84-a060-4bb2-af5a-d7e63e7ce6bb None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:24.687485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4c500-ddec-4f8e-b3a9-fc98e3e88857 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a418c5817e784d299c8d6daad20c6cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:24.688147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4c500-ddec-4f8e-b3a9-fc98e3e88857 service glance] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:24.688429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4c500-ddec-4f8e-b3a9-fc98e3e88857 service glance] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:24.688701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4c500-ddec-4f8e-b3a9-fc98e3e88857 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:24.699641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4c500-ddec-4f8e-b3a9-fc98e3e88857 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:24.701091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4c500-ddec-4f8e-b3a9-fc98e3e88857 service glance] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:24.711838 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1136/2312] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:24:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:24:24.777376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508644-b78d-458e-94a4-fc94a20c7428 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:24.777678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508644-b78d-458e-94a4-fc94a20c7428 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:24.777960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6508644-b78d-458e-94a4-fc94a20c7428 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:24.779362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1177/2313] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:24.784245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56136307-dbea-4342-b4e3-c75376f419b0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:24.784534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56136307-dbea-4342-b4e3-c75376f419b0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:24.784835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56136307-dbea-4342-b4e3-c75376f419b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:24.814383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-56136307-dbea-4342-b4e3-c75376f419b0 None None] MFA Rules not processed for user `fafd295a115c4f5d912e49d6a21d67b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:24.815605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-56136307-dbea-4342-b4e3-c75376f419b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:24.882468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1137/2314] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:24:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:24:24.893890 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6508644-b78d-458e-94a4-fc94a20c7428 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:24.895599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c6508644-b78d-458e-94a4-fc94a20c7428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:24.908829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6508644-b78d-458e-94a4-fc94a20c7428 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:24.912334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a0a73-f7d5-48cd-8cd0-b73ba73b2c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:24.912976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a0a73-f7d5-48cd-8cd0-b73ba73b2c07 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:24.913291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a0a73-f7d5-48cd-8cd0-b73ba73b2c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:24.913569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a0a73-f7d5-48cd-8cd0-b73ba73b2c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:24.921522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a0a73-f7d5-48cd-8cd0-b73ba73b2c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:24.922994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a0a73-f7d5-48cd-8cd0-b73ba73b2c07 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:24.931749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1178/2315] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:24:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:24:25.017949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8a9f-1456-429d-9124-38c1f38cf35a None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:25.018240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8a9f-1456-429d-9124-38c1f38cf35a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:25.018515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8a9f-1456-429d-9124-38c1f38cf35a None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:25.019929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1138/2316] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:24:25.025579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb83630-1491-47ea-a231-ba0c221d8e47 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:25.025877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb83630-1491-47ea-a231-ba0c221d8e47 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:25.026158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb83630-1491-47ea-a231-ba0c221d8e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:25.057316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ffb83630-1491-47ea-a231-ba0c221d8e47 None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:25.058769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ffb83630-1491-47ea-a231-ba0c221d8e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:25.075091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1179/2317] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:24:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:24:25.081548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8a9f-1456-429d-9124-38c1f38cf35a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:25.100553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff8a9f-1456-429d-9124-38c1f38cf35a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:25.104948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797b1b2-73a9-40fa-81d2-75ede5d7320c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:25.105684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797b1b2-73a9-40fa-81d2-75ede5d7320c service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:25.106041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797b1b2-73a9-40fa-81d2-75ede5d7320c service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:25.106389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797b1b2-73a9-40fa-81d2-75ede5d7320c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:25.122524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797b1b2-73a9-40fa-81d2-75ede5d7320c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:25.124218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797b1b2-73a9-40fa-81d2-75ede5d7320c service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:25.138643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1139/2318] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:24:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:24:27.505988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606b690-ada7-4e8b-80e2-1484f9a4c04f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:27.506977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606b690-ada7-4e8b-80e2-1484f9a4c04f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:27.507079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606b690-ada7-4e8b-80e2-1484f9a4c04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:27.528211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6606b690-ada7-4e8b-80e2-1484f9a4c04f None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:27.529588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6606b690-ada7-4e8b-80e2-1484f9a4c04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:27.540810 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1180/2319] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:24:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:24:27.554304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797b1b2-73a9-40fa-81d2-75ede5d7320c service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:27.567058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797b1b2-73a9-40fa-81d2-75ede5d7320c service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:27.573093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadba21-d966-4200-8954-0654b0701fc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:27.573817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadba21-d966-4200-8954-0654b0701fc9 service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:27.574079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadba21-d966-4200-8954-0654b0701fc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:27.574352 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadba21-d966-4200-8954-0654b0701fc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:27.583373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadba21-d966-4200-8954-0654b0701fc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:27.585519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadba21-d966-4200-8954-0654b0701fc9 service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:27.594057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1140/2320] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:24:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:24:37.522132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:37.590631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=50 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:46.231872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877988b-066e-45f6-b6f2-58824f39fc02 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:46.232377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877988b-066e-45f6-b6f2-58824f39fc02 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:46.232622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877988b-066e-45f6-b6f2-58824f39fc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:46.281732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3877988b-066e-45f6-b6f2-58824f39fc02 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:24:46.282952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3877988b-066e-45f6-b6f2-58824f39fc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:46.299797 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1181/2321] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jun 7 14:24:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:24:46.313189 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadba21-d966-4200-8954-0654b0701fc9 service swift] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:46.335604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadba21-d966-4200-8954-0654b0701fc9 service swift] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:46.340798 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4989ba-ddbc-4a19-b95b-3a24cf3ad56b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:46.341449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4989ba-ddbc-4a19-b95b-3a24cf3ad56b service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:46.341736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4989ba-ddbc-4a19-b95b-3a24cf3ad56b service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:46.342016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4989ba-ddbc-4a19-b95b-3a24cf3ad56b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:46.351367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4989ba-ddbc-4a19-b95b-3a24cf3ad56b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:46.353074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4989ba-ddbc-4a19-b95b-3a24cf3ad56b service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:46.361400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1141/2322] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:24:47.380030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877988b-066e-45f6-b6f2-58824f39fc02 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:47.390778 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877988b-066e-45f6-b6f2-58824f39fc02 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:47.394847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d38d3-ecbe-44ed-b3fe-ffbb66439ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:47.395845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d38d3-ecbe-44ed-b3fe-ffbb66439ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:47.396129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d38d3-ecbe-44ed-b3fe-ffbb66439ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:47.396407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d38d3-ecbe-44ed-b3fe-ffbb66439ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:47.407452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d38d3-ecbe-44ed-b3fe-ffbb66439ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:47.408879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d38d3-ecbe-44ed-b3fe-ffbb66439ce8 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:47.419198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1182/2323] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:24:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:24:48.224028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4989ba-ddbc-4a19-b95b-3a24cf3ad56b service swift] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:24:48.225984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8e4989ba-ddbc-4a19-b95b-3a24cf3ad56b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:48.318843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4989ba-ddbc-4a19-b95b-3a24cf3ad56b service swift] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:24:48.324151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812e4d-4b3c-4777-b7da-236f84c3c4ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:24:48.324841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812e4d-4b3c-4777-b7da-236f84c3c4ef service placement] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:24:48.325127 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812e4d-4b3c-4777-b7da-236f84c3c4ef service placement] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:24:48.325407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812e4d-4b3c-4777-b7da-236f84c3c4ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:24:48.327191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0d812e4d-4b3c-4777-b7da-236f84c3c4ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:24:48.339965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d812e4d-4b3c-4777-b7da-236f84c3c4ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:24:48.341361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d812e4d-4b3c-4777-b7da-236f84c3c4ef service placement] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:24:48.353652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1142/2324] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:24:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:24:57.414819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=24 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:24:58.347250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=51 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:23.323976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f9d40-ae06-46eb-b8aa-8ab61bed7e5e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:23.324510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f9d40-ae06-46eb-b8aa-8ab61bed7e5e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:23.324510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f9d40-ae06-46eb-b8aa-8ab61bed7e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:23.342371 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9e1f9d40-ae06-46eb-b8aa-8ab61bed7e5e None None] MFA Rules not processed for user `79b17e95e5f0434b854b196dee43154c`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:25:23.343604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9e1f9d40-ae06-46eb-b8aa-8ab61bed7e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:25:23.351084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1183/2325] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:25:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:25:33.337438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:37.175961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76417f-8fc3-406c-9e00-6620bde69983 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:37.176503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76417f-8fc3-406c-9e00-6620bde69983 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:37.176503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76417f-8fc3-406c-9e00-6620bde69983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:37.195056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-3c76417f-8fc3-406c-9e00-6620bde69983 None None] MFA Rules not processed for user `cabc5ecafe6d443c8459b8857a1e3242`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:25:37.196320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3c76417f-8fc3-406c-9e00-6620bde69983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:25:37.256867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1143/2326] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:25:42.304287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a8b91-f45f-438c-8478-ceef8128ffe3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:42.304825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a8b91-f45f-438c-8478-ceef8128ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:42.304996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a8b91-f45f-438c-8478-ceef8128ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:42.323468 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-200a8b91-f45f-438c-8478-ceef8128ffe3 None None] MFA Rules not processed for user `05ba6d637a31453b88ba4c18b47697b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:25:42.324667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-200a8b91-f45f-438c-8478-ceef8128ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:25:42.332188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1184/2327] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:25:47.249084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=25 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:52.318201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:25:56.902468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf01c6-eb2e-48c8-aa55-d1ce9dd637b0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:25:56.902980 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf01c6-eb2e-48c8-aa55-d1ce9dd637b0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:25:56.903080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf01c6-eb2e-48c8-aa55-d1ce9dd637b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:25:56.920627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b1bf01c6-eb2e-48c8-aa55-d1ce9dd637b0 None None] MFA Rules not processed for user `d619c0247a084d07941bd70c14b66b39`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:25:56.921811 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b1bf01c6-eb2e-48c8-aa55-d1ce9dd637b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:25:56.975433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1144/2328] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:25:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:06.968924 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=25 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:32.346643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a8b91-f45f-438c-8478-ceef8128ffe3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:32.349870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-200a8b91-f45f-438c-8478-ceef8128ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:32.444253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a8b91-f45f-438c-8478-ceef8128ffe3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:32.448764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:32.449640 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:32.449925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:32.450203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] PATH_INFO: `/v3/users/79b17e95e5f0434b854b196dee43154c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:32.451472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b17e95e5f0434b854b196dee43154c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:32.453400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:32.505582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b17e95e5f0434b854b196dee43154c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.514769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b17e95e5f0434b854b196dee43154c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.515600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b17e95e5f0434b854b196dee43154c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.523270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b17e95e5f0434b854b196dee43154c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.536406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-099a7261-ddbb-4372-9ecb-9140202c2a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b17e95e5f0434b854b196dee43154c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.542235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1185/2329] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:32 2022] DELETE /identity/v3/users/79b17e95e5f0434b854b196dee43154c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:32.719129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf01c6-eb2e-48c8-aa55-d1ce9dd637b0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:32.732315 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf01c6-eb2e-48c8-aa55-d1ce9dd637b0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:32.788855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:32.789704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:32.789987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:32.790260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] PATH_INFO: `/v3/projects/53badf9667a544499080c3f426b50942` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:32.791471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53badf9667a544499080c3f426b50942)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:32.793354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:32.837925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53badf9667a544499080c3f426b50942', 'request_id': 'req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.844027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53badf9667a544499080c3f426b50942', 'request_id': 'req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.851722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53badf9667a544499080c3f426b50942', 'request_id': 'req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.861817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] The token cache is being invalidate because project 53badf9667a544499080c3f426b50942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:32.862106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.862737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d4c01357-295c-4c9b-aaae-e8a6aaa5ffb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:32.864371 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1145/2330] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:32 2022] DELETE /identity/v3/projects/53badf9667a544499080c3f426b50942 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:32.869364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef3217-2024-4e47-a7ec-6a50775d77ce None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:32.869661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef3217-2024-4e47-a7ec-6a50775d77ce None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:32.869947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef3217-2024-4e47-a7ec-6a50775d77ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:32.915135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-cdef3217-2024-4e47-a7ec-6a50775d77ce None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:32.916362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cdef3217-2024-4e47-a7ec-6a50775d77ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:32.941466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:32.978044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1186/2331] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:32.986271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7219b-9848-4bb2-bc5a-381025e28510 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:32.986577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7219b-9848-4bb2-bc5a-381025e28510 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:32.986861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7219b-9848-4bb2-bc5a-381025e28510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.006229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-89f7219b-9848-4bb2-bc5a-381025e28510 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:33.007488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-89f7219b-9848-4bb2-bc5a-381025e28510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:33.015462 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1146/2332] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:33.019862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef3217-2024-4e47-a7ec-6a50775d77ce None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.029385 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef3217-2024-4e47-a7ec-6a50775d77ce None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.034266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e081c-d508-4a7d-b810-9f7eb1a61408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.034916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e081c-d508-4a7d-b810-9f7eb1a61408 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.035198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e081c-d508-4a7d-b810-9f7eb1a61408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.035517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e081c-d508-4a7d-b810-9f7eb1a61408 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.036253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e081c-d508-4a7d-b810-9f7eb1a61408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:26:33.036561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e081c-d508-4a7d-b810-9f7eb1a61408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.038148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e081c-d508-4a7d-b810-9f7eb1a61408 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.050001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1187/2333] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:26:33.054128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7219b-9848-4bb2-bc5a-381025e28510 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.063306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7219b-9848-4bb2-bc5a-381025e28510 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.068746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3d62a-5206-4eb9-9022-122f859d845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.069420 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3d62a-5206-4eb9-9022-122f859d845c admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.069700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3d62a-5206-4eb9-9022-122f859d845c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.069974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3d62a-5206-4eb9-9022-122f859d845c admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.070664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3d62a-5206-4eb9-9022-122f859d845c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.072569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3d62a-5206-4eb9-9022-122f859d845c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.097657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1147/2334] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:26:33 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:26:33.101817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e081c-d508-4a7d-b810-9f7eb1a61408 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.112317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e081c-d508-4a7d-b810-9f7eb1a61408 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.167942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd60ef3-b519-47d8-9d5d-15d21978670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.168608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd60ef3-b519-47d8-9d5d-15d21978670a admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.168895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd60ef3-b519-47d8-9d5d-15d21978670a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.169174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd60ef3-b519-47d8-9d5d-15d21978670a admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.169873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd60ef3-b519-47d8-9d5d-15d21978670a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.171832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd60ef3-b519-47d8-9d5d-15d21978670a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.191636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1188/2335] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:26:33 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:33.195732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3d62a-5206-4eb9-9022-122f859d845c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.206112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3d62a-5206-4eb9-9022-122f859d845c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.210771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efb617-21ca-46e9-8645-be2d03800706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.211475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efb617-21ca-46e9-8645-be2d03800706 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.211783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efb617-21ca-46e9-8645-be2d03800706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.212046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efb617-21ca-46e9-8645-be2d03800706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.212783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efb617-21ca-46e9-8645-be2d03800706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.214623 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efb617-21ca-46e9-8645-be2d03800706 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.225695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1148/2336] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:26:33.229768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd60ef3-b519-47d8-9d5d-15d21978670a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.240521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd60ef3-b519-47d8-9d5d-15d21978670a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.245077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f5049-741a-4595-8b1d-5606efe21554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.245734 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f5049-741a-4595-8b1d-5606efe21554 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.246017 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f5049-741a-4595-8b1d-5606efe21554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.246292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f5049-741a-4595-8b1d-5606efe21554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.247014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f5049-741a-4595-8b1d-5606efe21554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.248628 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f5049-741a-4595-8b1d-5606efe21554 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.259892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1189/2337] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:33.263972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efb617-21ca-46e9-8645-be2d03800706 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.274645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efb617-21ca-46e9-8645-be2d03800706 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.279256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91786a71-2528-4941-be81-f7d5984fb639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.280168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786a71-2528-4941-be81-f7d5984fb639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.280450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786a71-2528-4941-be81-f7d5984fb639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.280726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786a71-2528-4941-be81-f7d5984fb639 admin admin] PATH_INFO: `/v3/projects/270f50a6636140c280236c7da84542fd/users/a1b1198821dd4eb38a5cd730a395ff59/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.295616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91786a71-2528-4941-be81-f7d5984fb639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270f50a6636140c280236c7da84542fd, user_id=a1b1198821dd4eb38a5cd730a395ff59, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.298304 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91786a71-2528-4941-be81-f7d5984fb639 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.311104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1149/2338] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:33 2022] PUT /identity/v3/projects/270f50a6636140c280236c7da84542fd/users/a1b1198821dd4eb38a5cd730a395ff59/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:33.322953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe8ae-5f15-44db-af78-5aa21e51365a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.323270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe8ae-5f15-44db-af78-5aa21e51365a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.323578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe8ae-5f15-44db-af78-5aa21e51365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.355704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-23cbe8ae-5f15-44db-af78-5aa21e51365a None None] MFA Rules not processed for user `a1b1198821dd4eb38a5cd730a395ff59`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:33.357055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-23cbe8ae-5f15-44db-af78-5aa21e51365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:33.429482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1190/2339] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:33.434150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91786a71-2528-4941-be81-f7d5984fb639 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.465513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:33.510318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91786a71-2528-4941-be81-f7d5984fb639 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.514974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5df035-89c1-4219-97f7-c3f030b89d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.515674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df035-89c1-4219-97f7-c3f030b89d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.515955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df035-89c1-4219-97f7-c3f030b89d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.516234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5df035-89c1-4219-97f7-c3f030b89d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.516919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5df035-89c1-4219-97f7-c3f030b89d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.519401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5df035-89c1-4219-97f7-c3f030b89d97 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.548110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1150/2340] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:26:33 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:26:33.552349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbe8ae-5f15-44db-af78-5aa21e51365a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.563245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbe8ae-5f15-44db-af78-5aa21e51365a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.583757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:33.621575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f1c4d-b8b0-449e-bdae-c7cce584ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.622275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f1c4d-b8b0-449e-bdae-c7cce584ff62 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.622558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f1c4d-b8b0-449e-bdae-c7cce584ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.622945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f1c4d-b8b0-449e-bdae-c7cce584ff62 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.623685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f1c4d-b8b0-449e-bdae-c7cce584ff62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.625605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f1c4d-b8b0-449e-bdae-c7cce584ff62 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.651755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1191/2341] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:26:33 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:33.656182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5df035-89c1-4219-97f7-c3f030b89d97 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.667514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5df035-89c1-4219-97f7-c3f030b89d97 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.678067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44717ba0-7805-44e8-bc36-909889963133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.678760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44717ba0-7805-44e8-bc36-909889963133 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.679046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44717ba0-7805-44e8-bc36-909889963133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.679323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44717ba0-7805-44e8-bc36-909889963133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.680092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44717ba0-7805-44e8-bc36-909889963133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.682675 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44717ba0-7805-44e8-bc36-909889963133 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.695656 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1151/2342] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:33.699808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f1c4d-b8b0-449e-bdae-c7cce584ff62 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.711977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f1c4d-b8b0-449e-bdae-c7cce584ff62 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.717467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62abb5-3544-4ef5-8b97-86843caf8e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.718603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62abb5-3544-4ef5-8b97-86843caf8e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.719115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62abb5-3544-4ef5-8b97-86843caf8e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.719436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62abb5-3544-4ef5-8b97-86843caf8e4a admin admin] PATH_INFO: `/v3/projects/d2ef0b4cfc3442488fa8af3c489dd61d/users/3af9bd7dec91415c922f91744c03a634/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.737849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62abb5-3544-4ef5-8b97-86843caf8e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ef0b4cfc3442488fa8af3c489dd61d, user_id=3af9bd7dec91415c922f91744c03a634, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.740914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62abb5-3544-4ef5-8b97-86843caf8e4a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.757725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1192/2343] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:33 2022] PUT /identity/v3/projects/d2ef0b4cfc3442488fa8af3c489dd61d/users/3af9bd7dec91415c922f91744c03a634/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:26:33.761467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44717ba0-7805-44e8-bc36-909889963133 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.778103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44717ba0-7805-44e8-bc36-909889963133 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.867781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d48a7-4a37-4ed4-8645-f844166a8dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.868468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d48a7-4a37-4ed4-8645-f844166a8dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.869052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d48a7-4a37-4ed4-8645-f844166a8dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.869210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d48a7-4a37-4ed4-8645-f844166a8dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.869941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d48a7-4a37-4ed4-8645-f844166a8dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.871564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d48a7-4a37-4ed4-8645-f844166a8dfe admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.882561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1152/2344] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:33.886605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62abb5-3544-4ef5-8b97-86843caf8e4a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:33.896970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62abb5-3544-4ef5-8b97-86843caf8e4a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:33.901984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ef688-3f91-4a6d-a11b-ec99dc9407f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:33.902875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ef688-3f91-4a6d-a11b-ec99dc9407f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.903156 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ef688-3f91-4a6d-a11b-ec99dc9407f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.903536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ef688-3f91-4a6d-a11b-ec99dc9407f0 admin admin] PATH_INFO: `/v3/projects/d2ef0b4cfc3442488fa8af3c489dd61d/users/3af9bd7dec91415c922f91744c03a634/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.905620 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ef688-3f91-4a6d-a11b-ec99dc9407f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ef0b4cfc3442488fa8af3c489dd61d, user_id=3af9bd7dec91415c922f91744c03a634, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:33.908838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ef688-3f91-4a6d-a11b-ec99dc9407f0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:33.919493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1193/2345] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:33 2022] PUT /identity/v3/projects/d2ef0b4cfc3442488fa8af3c489dd61d/users/3af9bd7dec91415c922f91744c03a634/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:33.930118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16146-12c4-4cff-a09a-02c15244ef7b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:33.930415 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16146-12c4-4cff-a09a-02c15244ef7b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:33.930700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16146-12c4-4cff-a09a-02c15244ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:33.959449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-54d16146-12c4-4cff-a09a-02c15244ef7b None None] MFA Rules not processed for user `3af9bd7dec91415c922f91744c03a634`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:33.960692 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-54d16146-12c4-4cff-a09a-02c15244ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:34.029887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1153/2346] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:34.041484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ef688-3f91-4a6d-a11b-ec99dc9407f0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:34.043188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c19ef688-3f91-4a6d-a11b-ec99dc9407f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:34.121877 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ef688-3f91-4a6d-a11b-ec99dc9407f0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:34.125660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac76c1-81ef-4913-8f0b-bee19970a41d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:34.126330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac76c1-81ef-4913-8f0b-bee19970a41d service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:34.126626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac76c1-81ef-4913-8f0b-bee19970a41d service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:34.126903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac76c1-81ef-4913-8f0b-bee19970a41d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:34.136724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac76c1-81ef-4913-8f0b-bee19970a41d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:34.138162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac76c1-81ef-4913-8f0b-bee19970a41d service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:34.148492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1194/2347] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:34 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:34.222408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16146-12c4-4cff-a09a-02c15244ef7b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:34.232682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16146-12c4-4cff-a09a-02c15244ef7b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:34.237705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af017897-3b90-476e-93f6-669b291979e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:34.238383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af017897-3b90-476e-93f6-669b291979e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:34.238660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af017897-3b90-476e-93f6-669b291979e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:34.238941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af017897-3b90-476e-93f6-669b291979e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:34.259540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:34.310826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af017897-3b90-476e-93f6-669b291979e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:34.312297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af017897-3b90-476e-93f6-669b291979e3 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:34.322404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1154/2348] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:34.925588 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409c724-990a-408b-bc45-4a6d57f5c6ad None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:34.926031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409c724-990a-408b-bc45-4a6d57f5c6ad None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:34.926138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409c724-990a-408b-bc45-4a6d57f5c6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:34.943826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0409c724-990a-408b-bc45-4a6d57f5c6ad None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:34.945154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0409c724-990a-408b-bc45-4a6d57f5c6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:35.001658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1195/2349] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jun 7 14:26:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:35.048191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af017897-3b90-476e-93f6-669b291979e3 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:35.049598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-af017897-3b90-476e-93f6-669b291979e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:35.132850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af017897-3b90-476e-93f6-669b291979e3 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:35.137882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d682a9-eab9-4e2a-9edd-26b74fbd6784 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:35.138530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d682a9-eab9-4e2a-9edd-26b74fbd6784 service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:35.138814 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d682a9-eab9-4e2a-9edd-26b74fbd6784 service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:35.139087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d682a9-eab9-4e2a-9edd-26b74fbd6784 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:35.147644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d682a9-eab9-4e2a-9edd-26b74fbd6784 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:35.149414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d682a9-eab9-4e2a-9edd-26b74fbd6784 service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:35.157837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1155/2350] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:26:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:26:37.073125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409c724-990a-408b-bc45-4a6d57f5c6ad None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:37.079552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:37.149596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409c724-990a-408b-bc45-4a6d57f5c6ad None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:37.155617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:37.156698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:37.156984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:37.157264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] PATH_INFO: `/v3/users/a1b1198821dd4eb38a5cd730a395ff59` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:37.159042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b1198821dd4eb38a5cd730a395ff59)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:37.161007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:37.215544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b1198821dd4eb38a5cd730a395ff59'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.226415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b1198821dd4eb38a5cd730a395ff59'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.227660 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b1198821dd4eb38a5cd730a395ff59'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.238473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b1198821dd4eb38a5cd730a395ff59'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.254735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b1198821dd4eb38a5cd730a395ff59'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.263221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1196/2351] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:37 2022] DELETE /identity/v3/users/a1b1198821dd4eb38a5cd730a395ff59 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:37.268384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050effd-44ca-4bb7-b6a7-54de9d30dd61 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:37.268889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050effd-44ca-4bb7-b6a7-54de9d30dd61 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:37.268987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050effd-44ca-4bb7-b6a7-54de9d30dd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:37.287156 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1050effd-44ca-4bb7-b6a7-54de9d30dd61 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:37.288783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1050effd-44ca-4bb7-b6a7-54de9d30dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:37.399986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1156/2352] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:26:37.411926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:37.414657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:37.484562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64437d-63c6-4b92-96b5-ec8802af47a6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:37.488823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca070cbf-6f9c-4fac-8dca-ce680cc69a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:37.489643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca070cbf-6f9c-4fac-8dca-ce680cc69a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:37.490040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca070cbf-6f9c-4fac-8dca-ce680cc69a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:37.490904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca070cbf-6f9c-4fac-8dca-ce680cc69a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:37.501220 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca070cbf-6f9c-4fac-8dca-ce680cc69a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:37.502792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca070cbf-6f9c-4fac-8dca-ce680cc69a19 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:37.513244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1197/2353] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:37.807841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050effd-44ca-4bb7-b6a7-54de9d30dd61 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:37.809914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1050effd-44ca-4bb7-b6a7-54de9d30dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:37.827958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050effd-44ca-4bb7-b6a7-54de9d30dd61 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:37.834577 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:37.835553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:37.835843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:37.836175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] PATH_INFO: `/v3/projects/270f50a6636140c280236c7da84542fd` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:37.837471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270f50a6636140c280236c7da84542fd)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:37.839554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:37.884985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:37.897252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270f50a6636140c280236c7da84542fd', 'request_id': 'req-e2721de5-ac74-4fcf-8dba-c883a9986634'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.903955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270f50a6636140c280236c7da84542fd', 'request_id': 'req-e2721de5-ac74-4fcf-8dba-c883a9986634'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.912921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270f50a6636140c280236c7da84542fd', 'request_id': 'req-e2721de5-ac74-4fcf-8dba-c883a9986634'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.924205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] The token cache is being invalidate because project 270f50a6636140c280236c7da84542fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:37.924468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.925146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:37.926729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1157/2354] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:37 2022] DELETE /identity/v3/projects/270f50a6636140c280236c7da84542fd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:37.930887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca070cbf-6f9c-4fac-8dca-ce680cc69a19 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:37.942111 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca070cbf-6f9c-4fac-8dca-ce680cc69a19 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:37.969044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:38.006953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:38.007859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:38.008151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:38.008427 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] PATH_INFO: `/v3/users/3af9bd7dec91415c922f91744c03a634` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:38.009629 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af9bd7dec91415c922f91744c03a634)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:38.011585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:38.060110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af9bd7dec91415c922f91744c03a634'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.068888 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af9bd7dec91415c922f91744c03a634'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.069585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af9bd7dec91415c922f91744c03a634'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.076758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af9bd7dec91415c922f91744c03a634'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.093675 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3c9f883d-9433-46b5-ab24-3871e5f9d8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af9bd7dec91415c922f91744c03a634'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.105680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1198/2355] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:37 2022] DELETE /identity/v3/users/3af9bd7dec91415c922f91744c03a634 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:38.422164 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:38.424652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:38.448578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2721de5-ac74-4fcf-8dba-c883a9986634 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:38.532850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:38.534045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:38.534479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:38.535118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] PATH_INFO: `/v3/projects/d2ef0b4cfc3442488fa8af3c489dd61d` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:38.536763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ef0b4cfc3442488fa8af3c489dd61d)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:38.540868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:38.611873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ef0b4cfc3442488fa8af3c489dd61d', 'request_id': 'req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.622687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ef0b4cfc3442488fa8af3c489dd61d', 'request_id': 'req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.632066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ef0b4cfc3442488fa8af3c489dd61d', 'request_id': 'req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.649615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] The token cache is being invalidate because project d2ef0b4cfc3442488fa8af3c489dd61d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:38.649910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.650697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-57a4841a-0aa8-449f-9ad5-2f2b1ce6e2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:38.653979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1158/2356] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:38 2022] DELETE /identity/v3/projects/d2ef0b4cfc3442488fa8af3c489dd61d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:26:38.659589 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ca3d4-9905-42d2-a43a-42d05b543f40 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:38.660145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ca3d4-9905-42d2-a43a-42d05b543f40 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:38.660630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ca3d4-9905-42d2-a43a-42d05b543f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:38.684369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a91ca3d4-9905-42d2-a43a-42d05b543f40 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:38.685859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a91ca3d4-9905-42d2-a43a-42d05b543f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:38.777386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1199/2357] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:38.789406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a525fb-588a-465a-bfdd-42493af31022 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:38.789664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a525fb-588a-465a-bfdd-42493af31022 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:38.790425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a525fb-588a-465a-bfdd-42493af31022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:38.818844 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-96a525fb-588a-465a-bfdd-42493af31022 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:38.820112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-96a525fb-588a-465a-bfdd-42493af31022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:38.829857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1159/2358] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:38.834065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ca3d4-9905-42d2-a43a-42d05b543f40 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:38.844194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ca3d4-9905-42d2-a43a-42d05b543f40 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:38.849068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf27d4d-9b90-40ea-b8fc-7f2dae302d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:38.849861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf27d4d-9b90-40ea-b8fc-7f2dae302d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:38.850208 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf27d4d-9b90-40ea-b8fc-7f2dae302d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:38.850490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf27d4d-9b90-40ea-b8fc-7f2dae302d29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:38.851235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf27d4d-9b90-40ea-b8fc-7f2dae302d29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:26:38.851578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf27d4d-9b90-40ea-b8fc-7f2dae302d29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:38.853355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf27d4d-9b90-40ea-b8fc-7f2dae302d29 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:38.872498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1200/2359] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:26:38.877400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a525fb-588a-465a-bfdd-42493af31022 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:38.887775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a525fb-588a-465a-bfdd-42493af31022 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:38.897214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e4693-6e4c-4554-90d9-5742a3c65270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:38.898715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e4693-6e4c-4554-90d9-5742a3c65270 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:38.898988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e4693-6e4c-4554-90d9-5742a3c65270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:38.899267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e4693-6e4c-4554-90d9-5742a3c65270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:38.900103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e4693-6e4c-4554-90d9-5742a3c65270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:38.906796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e4693-6e4c-4554-90d9-5742a3c65270 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:38.964976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1160/2360] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:26:38 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:38.968961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf27d4d-9b90-40ea-b8fc-7f2dae302d29 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:38.979799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf27d4d-9b90-40ea-b8fc-7f2dae302d29 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.017174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:39.058249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca860bb3-b37d-486a-9915-c29a95272f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.059462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca860bb3-b37d-486a-9915-c29a95272f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.059846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca860bb3-b37d-486a-9915-c29a95272f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.060043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca860bb3-b37d-486a-9915-c29a95272f44 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.060855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca860bb3-b37d-486a-9915-c29a95272f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.062853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca860bb3-b37d-486a-9915-c29a95272f44 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.086499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1201/2361] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:26:38 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:39.091236 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e4693-6e4c-4554-90d9-5742a3c65270 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.103326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e4693-6e4c-4554-90d9-5742a3c65270 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.109624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f457de0-dc30-4f03-aae4-2a4fe09529f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.110303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457de0-dc30-4f03-aae4-2a4fe09529f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.111196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457de0-dc30-4f03-aae4-2a4fe09529f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.111512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f457de0-dc30-4f03-aae4-2a4fe09529f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.112264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f457de0-dc30-4f03-aae4-2a4fe09529f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.114223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f457de0-dc30-4f03-aae4-2a4fe09529f3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.129166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1161/2362] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:39.133009 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca860bb3-b37d-486a-9915-c29a95272f44 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.144066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca860bb3-b37d-486a-9915-c29a95272f44 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.163865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805531-027a-41d5-ae22-6d06b80d6048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.165678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805531-027a-41d5-ae22-6d06b80d6048 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.165678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805531-027a-41d5-ae22-6d06b80d6048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.165842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805531-027a-41d5-ae22-6d06b80d6048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.166802 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab805531-027a-41d5-ae22-6d06b80d6048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.168694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab805531-027a-41d5-ae22-6d06b80d6048 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.181138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1202/2363] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:39.185562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f457de0-dc30-4f03-aae4-2a4fe09529f3 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.202678 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f457de0-dc30-4f03-aae4-2a4fe09529f3 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.208123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d11703-2ee7-4f62-b547-b0aca91e297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.209315 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d11703-2ee7-4f62-b547-b0aca91e297d admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.209664 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d11703-2ee7-4f62-b547-b0aca91e297d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.211613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d11703-2ee7-4f62-b547-b0aca91e297d admin admin] PATH_INFO: `/v3/projects/81bdaf059b504201b54732552aa825e5/users/a455b20faf8c44d3b48a5017ba407015/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.225518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:39.231373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d11703-2ee7-4f62-b547-b0aca91e297d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bdaf059b504201b54732552aa825e5, user_id=a455b20faf8c44d3b48a5017ba407015, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.235114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d11703-2ee7-4f62-b547-b0aca91e297d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.257154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1162/2364] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:39 2022] PUT /identity/v3/projects/81bdaf059b504201b54732552aa825e5/users/a455b20faf8c44d3b48a5017ba407015/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:39.268337 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cd746-489c-4d2d-8800-24a73e9410cd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.268873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cd746-489c-4d2d-8800-24a73e9410cd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.269325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cd746-489c-4d2d-8800-24a73e9410cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.297273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ff1cd746-489c-4d2d-8800-24a73e9410cd None None] MFA Rules not processed for user `a455b20faf8c44d3b48a5017ba407015`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:39.299057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ff1cd746-489c-4d2d-8800-24a73e9410cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:39.384047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1203/2365] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:26:39.388420 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d11703-2ee7-4f62-b547-b0aca91e297d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.473544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d11703-2ee7-4f62-b547-b0aca91e297d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.479731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d53552-1596-46bc-a1c5-31196a638e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.480796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d53552-1596-46bc-a1c5-31196a638e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.481334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d53552-1596-46bc-a1c5-31196a638e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.481821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d53552-1596-46bc-a1c5-31196a638e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.482785 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d53552-1596-46bc-a1c5-31196a638e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.484985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d53552-1596-46bc-a1c5-31196a638e94 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.519041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1163/2366] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:26:39 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:39.522746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cd746-489c-4d2d-8800-24a73e9410cd None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.535092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cd746-489c-4d2d-8800-24a73e9410cd None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.599394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13563294-4ba9-4be6-8c02-558263864b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.600058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563294-4ba9-4be6-8c02-558263864b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.600344 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563294-4ba9-4be6-8c02-558263864b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.600621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13563294-4ba9-4be6-8c02-558263864b90 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.601356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13563294-4ba9-4be6-8c02-558263864b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.603263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13563294-4ba9-4be6-8c02-558263864b90 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.626649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1204/2367] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:26:39 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:39.627971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d53552-1596-46bc-a1c5-31196a638e94 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.638397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d53552-1596-46bc-a1c5-31196a638e94 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.643518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef26b64-b76d-49e6-99d9-71ef15f4e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.644176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef26b64-b76d-49e6-99d9-71ef15f4e6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.644456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef26b64-b76d-49e6-99d9-71ef15f4e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.644728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef26b64-b76d-49e6-99d9-71ef15f4e6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.645455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef26b64-b76d-49e6-99d9-71ef15f4e6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.647036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef26b64-b76d-49e6-99d9-71ef15f4e6ba admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.658129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1164/2368] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:39.662405 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13563294-4ba9-4be6-8c02-558263864b90 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.672231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13563294-4ba9-4be6-8c02-558263864b90 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.676916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4b94f-fa95-413d-81ad-ab650d01e8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.677795 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4b94f-fa95-413d-81ad-ab650d01e8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.678076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4b94f-fa95-413d-81ad-ab650d01e8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.678351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4b94f-fa95-413d-81ad-ab650d01e8b5 admin admin] PATH_INFO: `/v3/projects/e146fea6e5af46daaa684a79c3b67a50/users/f853d6faffd146739fdd3db82099eeb5/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.693590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4b94f-fa95-413d-81ad-ab650d01e8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e146fea6e5af46daaa684a79c3b67a50, user_id=f853d6faffd146739fdd3db82099eeb5, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.696411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4b94f-fa95-413d-81ad-ab650d01e8b5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.710664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1205/2369] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:39 2022] PUT /identity/v3/projects/e146fea6e5af46daaa684a79c3b67a50/users/f853d6faffd146739fdd3db82099eeb5/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:39.714629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef26b64-b76d-49e6-99d9-71ef15f4e6ba admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.725711 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef26b64-b76d-49e6-99d9-71ef15f4e6ba admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.781354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d1b07-511b-4287-8ed0-2d89e80a256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.782032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d1b07-511b-4287-8ed0-2d89e80a256e admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.782889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d1b07-511b-4287-8ed0-2d89e80a256e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.783168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d1b07-511b-4287-8ed0-2d89e80a256e admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.783967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d1b07-511b-4287-8ed0-2d89e80a256e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.785538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d1b07-511b-4287-8ed0-2d89e80a256e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.795149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1165/2370] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:39.799583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4b94f-fa95-413d-81ad-ab650d01e8b5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.809948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4b94f-fa95-413d-81ad-ab650d01e8b5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:39.814773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d83fe3-a195-4106-89ed-b6ce912f2086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:39.815695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d83fe3-a195-4106-89ed-b6ce912f2086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.815983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d83fe3-a195-4106-89ed-b6ce912f2086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.816267 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d83fe3-a195-4106-89ed-b6ce912f2086 admin admin] PATH_INFO: `/v3/projects/e146fea6e5af46daaa684a79c3b67a50/users/f853d6faffd146739fdd3db82099eeb5/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.818268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d83fe3-a195-4106-89ed-b6ce912f2086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e146fea6e5af46daaa684a79c3b67a50, user_id=f853d6faffd146739fdd3db82099eeb5, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:39.820967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d83fe3-a195-4106-89ed-b6ce912f2086 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:39.824684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:39.834998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1206/2371] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:39 2022] PUT /identity/v3/projects/e146fea6e5af46daaa684a79c3b67a50/users/f853d6faffd146739fdd3db82099eeb5/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:39.845439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985c854-1495-4f44-a412-7db9b2261e5f None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:39.845737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985c854-1495-4f44-a412-7db9b2261e5f None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:39.846020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985c854-1495-4f44-a412-7db9b2261e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:39.872140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a985c854-1495-4f44-a412-7db9b2261e5f None None] MFA Rules not processed for user `f853d6faffd146739fdd3db82099eeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:39.873343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a985c854-1495-4f44-a412-7db9b2261e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:39.921851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:39.946045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1166/2372] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:39.959560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d83fe3-a195-4106-89ed-b6ce912f2086 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:39.961286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a6d83fe3-a195-4106-89ed-b6ce912f2086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:40.023969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d83fe3-a195-4106-89ed-b6ce912f2086 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:40.029936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f8a82-9fed-4711-a6c5-6d5540efe6ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:40.030622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f8a82-9fed-4711-a6c5-6d5540efe6ac service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:40.030907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f8a82-9fed-4711-a6c5-6d5540efe6ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:40.031234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f8a82-9fed-4711-a6c5-6d5540efe6ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:40.041668 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f8a82-9fed-4711-a6c5-6d5540efe6ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:40.043545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f8a82-9fed-4711-a6c5-6d5540efe6ac service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:40.055246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1207/2373] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:40.103756 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985c854-1495-4f44-a412-7db9b2261e5f None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:40.105241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a985c854-1495-4f44-a412-7db9b2261e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:40.118737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985c854-1495-4f44-a412-7db9b2261e5f None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:40.122704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe603ba-11f0-44cc-8f73-91ca70396180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:40.123556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe603ba-11f0-44cc-8f73-91ca70396180 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:40.123880 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe603ba-11f0-44cc-8f73-91ca70396180 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:40.124122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe603ba-11f0-44cc-8f73-91ca70396180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:40.190441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe603ba-11f0-44cc-8f73-91ca70396180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:40.192077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe603ba-11f0-44cc-8f73-91ca70396180 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:40.201694 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1167/2374] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:42.597445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f8a82-9fed-4711-a6c5-6d5540efe6ac service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:42.598862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7b4f8a82-9fed-4711-a6c5-6d5540efe6ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:42.665193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f8a82-9fed-4711-a6c5-6d5540efe6ac service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:42.669806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:42.670678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:42.670960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:42.671236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] PATH_INFO: `/v3/users/5a8f90dff27d4c04988c3474e3a5532f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:42.672458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8f90dff27d4c04988c3474e3a5532f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:42.674356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:42.719112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8f90dff27d4c04988c3474e3a5532f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:42.726533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8f90dff27d4c04988c3474e3a5532f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:42.727195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8f90dff27d4c04988c3474e3a5532f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:42.734459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8f90dff27d4c04988c3474e3a5532f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:42.747656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8f90dff27d4c04988c3474e3a5532f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:42.753507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1208/2375] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:42 2022] DELETE /identity/v3/users/5a8f90dff27d4c04988c3474e3a5532f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:42.928843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe603ba-11f0-44cc-8f73-91ca70396180 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:42.942896 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe603ba-11f0-44cc-8f73-91ca70396180 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:43.003423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:43.004326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:43.004605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:43.004909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] PATH_INFO: `/v3/projects/beb4ec35ffe94dfe8974f9f0aa474c11` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:43.006382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb4ec35ffe94dfe8974f9f0aa474c11)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:43.008348 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:43.060228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb4ec35ffe94dfe8974f9f0aa474c11', 'request_id': 'req-dae3b588-4dbb-4905-8f53-f9f1730f6b01'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.067192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb4ec35ffe94dfe8974f9f0aa474c11', 'request_id': 'req-dae3b588-4dbb-4905-8f53-f9f1730f6b01'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.074917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb4ec35ffe94dfe8974f9f0aa474c11', 'request_id': 'req-dae3b588-4dbb-4905-8f53-f9f1730f6b01'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.086110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] The token cache is being invalidate because project beb4ec35ffe94dfe8974f9f0aa474c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:43.086397 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.087024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.088654 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1168/2376] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:42 2022] DELETE /identity/v3/projects/beb4ec35ffe94dfe8974f9f0aa474c11 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:43.092503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:43.093903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:43.106937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398cd38-f91e-48da-84c0-fef114553ae4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:43.118561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:43.166460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:43.167362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:43.167649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:43.167928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] PATH_INFO: `/v3/users/2b4cf7d8c73a4372a1bb1c8506da8d71` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:43.169113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4cf7d8c73a4372a1bb1c8506da8d71)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:43.170997 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:43.223498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4cf7d8c73a4372a1bb1c8506da8d71'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.232012 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4cf7d8c73a4372a1bb1c8506da8d71'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.232852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4cf7d8c73a4372a1bb1c8506da8d71'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.248504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4cf7d8c73a4372a1bb1c8506da8d71'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.265088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4cf7d8c73a4372a1bb1c8506da8d71'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.277211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1209/2377] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:43 2022] DELETE /identity/v3/users/2b4cf7d8c73a4372a1bb1c8506da8d71 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:43.554731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:43.557673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:43.575310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3b588-4dbb-4905-8f53-f9f1730f6b01 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:43.585537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:43.653207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:43.654365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:43.654754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:43.655037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] PATH_INFO: `/v3/projects/257d601f3a654a2598498470efe63c3c` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:43.656310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=257d601f3a654a2598498470efe63c3c)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:43.658832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:43.710237 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257d601f3a654a2598498470efe63c3c', 'request_id': 'req-7341f5a4-127a-4970-abfc-f79b396a03f9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.717225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257d601f3a654a2598498470efe63c3c', 'request_id': 'req-7341f5a4-127a-4970-abfc-f79b396a03f9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.724618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257d601f3a654a2598498470efe63c3c', 'request_id': 'req-7341f5a4-127a-4970-abfc-f79b396a03f9'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.739521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] The token cache is being invalidate because project 257d601f3a654a2598498470efe63c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:43.739810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.740487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7341f5a4-127a-4970-abfc-f79b396a03f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:43.742388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1169/2378] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:43 2022] DELETE /identity/v3/projects/257d601f3a654a2598498470efe63c3c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:43.887033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:43.889420 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:43.903707 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc725b32-ae13-4f13-8ae9-57b3ec26bf00 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:43.980988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:43.982110 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:43.982401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:43.982682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] PATH_INFO: `/v3/users/a455b20faf8c44d3b48a5017ba407015` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:43.984031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a455b20faf8c44d3b48a5017ba407015)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:43.986587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:44.031706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:44.041786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a455b20faf8c44d3b48a5017ba407015'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.049635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a455b20faf8c44d3b48a5017ba407015'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.050315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a455b20faf8c44d3b48a5017ba407015'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.057907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a455b20faf8c44d3b48a5017ba407015'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.070209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a455b20faf8c44d3b48a5017ba407015'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.076271 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1210/2379] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:43 2022] DELETE /identity/v3/users/a455b20faf8c44d3b48a5017ba407015 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:44.081351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679182-7b2c-4e47-af87-dbc4b0826b17 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:44.081870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679182-7b2c-4e47-af87-dbc4b0826b17 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:44.081966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f679182-7b2c-4e47-af87-dbc4b0826b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:44.101135 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4f679182-7b2c-4e47-af87-dbc4b0826b17 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:44.102345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4f679182-7b2c-4e47-af87-dbc4b0826b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:44.160958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1170/2380] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:26:44.170820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:44.172245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:44.228426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7782a90-30df-4354-8f0a-0a63c63c2f54 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:44.232027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef573b-57bf-4680-8e79-87a83325abcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:44.232663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef573b-57bf-4680-8e79-87a83325abcb service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:44.232944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef573b-57bf-4680-8e79-87a83325abcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:44.233215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef573b-57bf-4680-8e79-87a83325abcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:44.242485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef573b-57bf-4680-8e79-87a83325abcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:44.244053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef573b-57bf-4680-8e79-87a83325abcb service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:44.253311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1211/2381] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:44.525744 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679182-7b2c-4e47-af87-dbc4b0826b17 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:44.527478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4f679182-7b2c-4e47-af87-dbc4b0826b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:44.545471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f679182-7b2c-4e47-af87-dbc4b0826b17 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:44.550827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:44.551955 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:44.552459 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:44.553023 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] PATH_INFO: `/v3/projects/81bdaf059b504201b54732552aa825e5` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:44.554416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81bdaf059b504201b54732552aa825e5)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:44.557224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:44.614252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:44.627356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81bdaf059b504201b54732552aa825e5', 'request_id': 'req-44fd0d13-ed22-43cd-a794-7bfea3696c69'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.635631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81bdaf059b504201b54732552aa825e5', 'request_id': 'req-44fd0d13-ed22-43cd-a794-7bfea3696c69'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.648905 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81bdaf059b504201b54732552aa825e5', 'request_id': 'req-44fd0d13-ed22-43cd-a794-7bfea3696c69'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.662056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] The token cache is being invalidate because project 81bdaf059b504201b54732552aa825e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:44.662056 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.662697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.664723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1171/2382] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:44 2022] DELETE /identity/v3/projects/81bdaf059b504201b54732552aa825e5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:26:44.668365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef573b-57bf-4680-8e79-87a83325abcb service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:44.677968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef573b-57bf-4680-8e79-87a83325abcb service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:44.745925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:44.746813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:44.747093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:44.747396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] PATH_INFO: `/v3/users/f853d6faffd146739fdd3db82099eeb5` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:44.748580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f853d6faffd146739fdd3db82099eeb5)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:44.750469 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:44.800273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f853d6faffd146739fdd3db82099eeb5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.807086 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f853d6faffd146739fdd3db82099eeb5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.807701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f853d6faffd146739fdd3db82099eeb5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.810167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:44.816285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f853d6faffd146739fdd3db82099eeb5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.828570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-265fc79d-47c8-4647-854c-5ba187d892c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f853d6faffd146739fdd3db82099eeb5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:44.834486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1212/2383] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:44 2022] DELETE /identity/v3/users/f853d6faffd146739fdd3db82099eeb5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:26:45.111028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:45.112506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:45.127957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd0d13-ed22-43cd-a794-7bfea3696c69 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:45.185066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:45.185934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.186221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.186500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] PATH_INFO: `/v3/projects/e146fea6e5af46daaa684a79c3b67a50` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.187720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e146fea6e5af46daaa684a79c3b67a50)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:45.189897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:45.235929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e146fea6e5af46daaa684a79c3b67a50', 'request_id': 'req-7ca5ec30-4560-4b37-bd08-90b03a8b8285'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:45.242240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e146fea6e5af46daaa684a79c3b67a50', 'request_id': 'req-7ca5ec30-4560-4b37-bd08-90b03a8b8285'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:45.249066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e146fea6e5af46daaa684a79c3b67a50', 'request_id': 'req-7ca5ec30-4560-4b37-bd08-90b03a8b8285'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:45.259698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] The token cache is being invalidate because project e146fea6e5af46daaa684a79c3b67a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:45.259985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:45.260636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-7ca5ec30-4560-4b37-bd08-90b03a8b8285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:45.262216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1172/2384] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:45 2022] DELETE /identity/v3/projects/e146fea6e5af46daaa684a79c3b67a50 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:45.268002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ac6a-726a-4025-9e79-859f2b5b4563 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.268500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ac6a-726a-4025-9e79-859f2b5b4563 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.268607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94ac6a-726a-4025-9e79-859f2b5b4563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.286139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5e94ac6a-726a-4025-9e79-859f2b5b4563 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:45.287316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5e94ac6a-726a-4025-9e79-859f2b5b4563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:45.345313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1213/2385] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:45.354521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003923-f615-4c2e-9c7a-6fbc94faae21 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.354737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003923-f615-4c2e-9c7a-6fbc94faae21 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.355025 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76003923-f615-4c2e-9c7a-6fbc94faae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.373587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-76003923-f615-4c2e-9c7a-6fbc94faae21 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:45.374790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-76003923-f615-4c2e-9c7a-6fbc94faae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:45.382640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1173/2386] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:45.386631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ac6a-726a-4025-9e79-859f2b5b4563 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:45.396491 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94ac6a-726a-4025-9e79-859f2b5b4563 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:45.401215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0edc-600e-4681-af43-185c1db2e9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:45.401874 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0edc-600e-4681-af43-185c1db2e9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.402161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0edc-600e-4681-af43-185c1db2e9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.402440 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f0edc-600e-4681-af43-185c1db2e9d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.403259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f0edc-600e-4681-af43-185c1db2e9d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:26:45.403605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f0edc-600e-4681-af43-185c1db2e9d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:45.405197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f0edc-600e-4681-af43-185c1db2e9d5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:45.417228 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1214/2387] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:26:45.421419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76003923-f615-4c2e-9c7a-6fbc94faae21 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:45.431282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76003923-f615-4c2e-9c7a-6fbc94faae21 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:45.435912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74322089-d259-4bac-9ab5-3e011c51ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:45.436565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322089-d259-4bac-9ab5-3e011c51ebf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.436847 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322089-d259-4bac-9ab5-3e011c51ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.437120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74322089-d259-4bac-9ab5-3e011c51ebf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.437801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74322089-d259-4bac-9ab5-3e011c51ebf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:45.439982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74322089-d259-4bac-9ab5-3e011c51ebf0 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:45.464156 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1174/2388] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:26:45 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:45.468306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0edc-600e-4681-af43-185c1db2e9d5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:45.478607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f0edc-600e-4681-af43-185c1db2e9d5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:45.533917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9f60c-1fc2-4bff-a213-6f3842e4d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:45.534583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f60c-1fc2-4bff-a213-6f3842e4d0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.534867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f60c-1fc2-4bff-a213-6f3842e4d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.535145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9f60c-1fc2-4bff-a213-6f3842e4d0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.535875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9f60c-1fc2-4bff-a213-6f3842e4d0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:45.537771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9f60c-1fc2-4bff-a213-6f3842e4d0f3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:45.557901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1215/2389] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:26:45 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:45.562125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74322089-d259-4bac-9ab5-3e011c51ebf0 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:45.572563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74322089-d259-4bac-9ab5-3e011c51ebf0 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:45.577146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea8a2a-2403-43df-af81-449c57f6b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:45.577800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea8a2a-2403-43df-af81-449c57f6b508 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.578082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea8a2a-2403-43df-af81-449c57f6b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.578359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea8a2a-2403-43df-af81-449c57f6b508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.579619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea8a2a-2403-43df-af81-449c57f6b508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:45.581201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea8a2a-2403-43df-af81-449c57f6b508 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:45.591364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1175/2390] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:45.595750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9f60c-1fc2-4bff-a213-6f3842e4d0f3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:45.605466 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9f60c-1fc2-4bff-a213-6f3842e4d0f3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:45.610117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99306d45-a72b-4e86-8766-400fb2221b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:45.610770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306d45-a72b-4e86-8766-400fb2221b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.611054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306d45-a72b-4e86-8766-400fb2221b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.611350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306d45-a72b-4e86-8766-400fb2221b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.612108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306d45-a72b-4e86-8766-400fb2221b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:45.613667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306d45-a72b-4e86-8766-400fb2221b01 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:45.623426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1216/2391] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:45.627295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea8a2a-2403-43df-af81-449c57f6b508 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:45.637343 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea8a2a-2403-43df-af81-449c57f6b508 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:45.642518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb440b90-f0b0-4642-b63e-fe443c9d3e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:45.643426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb440b90-f0b0-4642-b63e-fe443c9d3e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.643734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb440b90-f0b0-4642-b63e-fe443c9d3e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.644045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb440b90-f0b0-4642-b63e-fe443c9d3e03 admin admin] PATH_INFO: `/v3/projects/70cd461a6c2f4a1bb4b81407befd5058/users/a7e6391617d2426b872d1dbf1a1395fc/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.658801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb440b90-f0b0-4642-b63e-fe443c9d3e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cd461a6c2f4a1bb4b81407befd5058, user_id=a7e6391617d2426b872d1dbf1a1395fc, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:45.661455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb440b90-f0b0-4642-b63e-fe443c9d3e03 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:45.663627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:45.674956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1176/2392] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:45 2022] PUT /identity/v3/projects/70cd461a6c2f4a1bb4b81407befd5058/users/a7e6391617d2426b872d1dbf1a1395fc/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:45.684993 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e32f-55ca-4d8d-b976-69446b423d49 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.685287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e32f-55ca-4d8d-b976-69446b423d49 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.685591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e32f-55ca-4d8d-b976-69446b423d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.711864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1b73e32f-55ca-4d8d-b976-69446b423d49 None None] MFA Rules not processed for user `a7e6391617d2426b872d1dbf1a1395fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:45.713058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1b73e32f-55ca-4d8d-b976-69446b423d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:45.742489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:45.778786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1217/2393] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:26:45.784088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb440b90-f0b0-4642-b63e-fe443c9d3e03 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:45.853107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb440b90-f0b0-4642-b63e-fe443c9d3e03 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:45.857930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045af1-6273-40be-8bd3-667d8b884592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:45.858537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045af1-6273-40be-8bd3-667d8b884592 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.858825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045af1-6273-40be-8bd3-667d8b884592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.859104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed045af1-6273-40be-8bd3-667d8b884592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.860016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045af1-6273-40be-8bd3-667d8b884592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:45.861982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed045af1-6273-40be-8bd3-667d8b884592 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:45.898041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e32f-55ca-4d8d-b976-69446b423d49 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:45.899677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1177/2394] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:26:45 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:45.909030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e32f-55ca-4d8d-b976-69446b423d49 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:45.977817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac518d45-72a2-43ae-8557-4bd9c196fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:45.978491 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac518d45-72a2-43ae-8557-4bd9c196fa19 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:45.978772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac518d45-72a2-43ae-8557-4bd9c196fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:45.979048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac518d45-72a2-43ae-8557-4bd9c196fa19 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:45.979814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac518d45-72a2-43ae-8557-4bd9c196fa19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:45.981706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac518d45-72a2-43ae-8557-4bd9c196fa19 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:46.001430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1218/2395] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:26:45 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:26:46.005583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045af1-6273-40be-8bd3-667d8b884592 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:46.015938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed045af1-6273-40be-8bd3-667d8b884592 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:46.021155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46c73b-40b6-41b5-9c34-792a6f8603bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:46.021813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46c73b-40b6-41b5-9c34-792a6f8603bf admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:46.022098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46c73b-40b6-41b5-9c34-792a6f8603bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:46.022375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46c73b-40b6-41b5-9c34-792a6f8603bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:46.023105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46c73b-40b6-41b5-9c34-792a6f8603bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:46.024728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46c73b-40b6-41b5-9c34-792a6f8603bf admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:46.035912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1178/2396] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:46.039849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac518d45-72a2-43ae-8557-4bd9c196fa19 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:46.050152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac518d45-72a2-43ae-8557-4bd9c196fa19 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:46.054665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4c73b-4f8e-489f-9db9-4b9093627bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:46.055574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4c73b-4f8e-489f-9db9-4b9093627bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:46.055856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4c73b-4f8e-489f-9db9-4b9093627bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:46.056143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4c73b-4f8e-489f-9db9-4b9093627bbf admin admin] PATH_INFO: `/v3/projects/c89e79855ac84e39a3946c93fbce6db3/users/7875897b0c8d44719ae8745a0d2fbad6/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:46.071559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4c73b-4f8e-489f-9db9-4b9093627bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89e79855ac84e39a3946c93fbce6db3, user_id=7875897b0c8d44719ae8745a0d2fbad6, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:46.074197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c4c73b-4f8e-489f-9db9-4b9093627bbf admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:46.087288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1219/2397] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:46 2022] PUT /identity/v3/projects/c89e79855ac84e39a3946c93fbce6db3/users/7875897b0c8d44719ae8745a0d2fbad6/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:46.091323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46c73b-40b6-41b5-9c34-792a6f8603bf admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:46.101892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46c73b-40b6-41b5-9c34-792a6f8603bf admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:46.159403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a3fb9-3b49-4556-aff4-382cd1746b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:46.160065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3fb9-3b49-4556-aff4-382cd1746b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:46.160353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3fb9-3b49-4556-aff4-382cd1746b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:46.160630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a3fb9-3b49-4556-aff4-382cd1746b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:46.161364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a3fb9-3b49-4556-aff4-382cd1746b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:46.162959 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a3fb9-3b49-4556-aff4-382cd1746b0f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:46.173591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1179/2398] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:46.177727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4c73b-4f8e-489f-9db9-4b9093627bbf admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:46.188051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4c73b-4f8e-489f-9db9-4b9093627bbf admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:46.192984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc7c21-2e11-4a55-9dfe-70ae9a40a6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:46.193860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc7c21-2e11-4a55-9dfe-70ae9a40a6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:46.194145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc7c21-2e11-4a55-9dfe-70ae9a40a6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:46.194421 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc7c21-2e11-4a55-9dfe-70ae9a40a6f6 admin admin] PATH_INFO: `/v3/projects/c89e79855ac84e39a3946c93fbce6db3/users/7875897b0c8d44719ae8745a0d2fbad6/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:46.196430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc7c21-2e11-4a55-9dfe-70ae9a40a6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89e79855ac84e39a3946c93fbce6db3, user_id=7875897b0c8d44719ae8745a0d2fbad6, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:46.199136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc7c21-2e11-4a55-9dfe-70ae9a40a6f6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:46.209550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1220/2399] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:46 2022] PUT /identity/v3/projects/c89e79855ac84e39a3946c93fbce6db3/users/7875897b0c8d44719ae8745a0d2fbad6/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:46.220132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50192958-3c25-4634-a2e1-7352f8b43b39 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:46.220422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50192958-3c25-4634-a2e1-7352f8b43b39 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:46.220697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50192958-3c25-4634-a2e1-7352f8b43b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:46.246663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-50192958-3c25-4634-a2e1-7352f8b43b39 None None] MFA Rules not processed for user `7875897b0c8d44719ae8745a0d2fbad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:46.247886 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-50192958-3c25-4634-a2e1-7352f8b43b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:46.297192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:46.316313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1180/2400] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:46.326794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc7c21-2e11-4a55-9dfe-70ae9a40a6f6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:46.328581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6fbc7c21-2e11-4a55-9dfe-70ae9a40a6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:46.387903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc7c21-2e11-4a55-9dfe-70ae9a40a6f6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:46.392089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4d7e-3cfc-49d2-aa01-38cdadf3f5bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:46.392740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4d7e-3cfc-49d2-aa01-38cdadf3f5bf service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:46.393029 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4d7e-3cfc-49d2-aa01-38cdadf3f5bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:46.393310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4d7e-3cfc-49d2-aa01-38cdadf3f5bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:46.402559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4d7e-3cfc-49d2-aa01-38cdadf3f5bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:46.404013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4d7e-3cfc-49d2-aa01-38cdadf3f5bf service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:46.414522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1221/2401] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:46.783455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50192958-3c25-4634-a2e1-7352f8b43b39 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:46.871736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50192958-3c25-4634-a2e1-7352f8b43b39 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:46.877800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:46.878908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:46.879221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:46.879833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] PATH_INFO: `/v3/users/a7e6391617d2426b872d1dbf1a1395fc` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:46.881522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e6391617d2426b872d1dbf1a1395fc)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:46.884418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:46.951552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e6391617d2426b872d1dbf1a1395fc'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:46.952517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e6391617d2426b872d1dbf1a1395fc'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:46.964291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e6391617d2426b872d1dbf1a1395fc'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:46.965248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e6391617d2426b872d1dbf1a1395fc'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:46.991582 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e6391617d2426b872d1dbf1a1395fc'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:47.022501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1181/2402] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:46 2022] DELETE /identity/v3/users/a7e6391617d2426b872d1dbf1a1395fc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:47.027330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35963740-5f72-4f88-a9b6-867d1627466a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:47.027330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35963740-5f72-4f88-a9b6-867d1627466a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:47.027592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35963740-5f72-4f88-a9b6-867d1627466a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:47.052805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-35963740-5f72-4f88-a9b6-867d1627466a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:47.054155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-35963740-5f72-4f88-a9b6-867d1627466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:47.080042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:47.128808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1222/2403] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:47.141713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:47.143550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:47.228659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974aaea-12eb-4a5f-960d-c9c089fbed78 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:47.236768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c5cba-891c-4672-ac87-0fcb9bdc2569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:47.237567 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c5cba-891c-4672-ac87-0fcb9bdc2569 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:47.237953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c5cba-891c-4672-ac87-0fcb9bdc2569 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:47.238421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c5cba-891c-4672-ac87-0fcb9bdc2569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:47.263147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c5cba-891c-4672-ac87-0fcb9bdc2569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:47.263147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c5cba-891c-4672-ac87-0fcb9bdc2569 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:47.273740 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1182/2404] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:47.686284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35963740-5f72-4f88-a9b6-867d1627466a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:47.688447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-35963740-5f72-4f88-a9b6-867d1627466a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:47.710235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35963740-5f72-4f88-a9b6-867d1627466a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:47.716519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:47.717337 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:47.717622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:47.717898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] PATH_INFO: `/v3/projects/70cd461a6c2f4a1bb4b81407befd5058` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:47.719922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cd461a6c2f4a1bb4b81407befd5058)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:47.722743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:47.778409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cd461a6c2f4a1bb4b81407befd5058', 'request_id': 'req-add7390b-3301-4069-bb15-1ac8f16bbbeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:47.787801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cd461a6c2f4a1bb4b81407befd5058', 'request_id': 'req-add7390b-3301-4069-bb15-1ac8f16bbbeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:47.795102 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cd461a6c2f4a1bb4b81407befd5058', 'request_id': 'req-add7390b-3301-4069-bb15-1ac8f16bbbeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:47.815275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] The token cache is being invalidate because project 70cd461a6c2f4a1bb4b81407befd5058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:47.815772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:47.816460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:47.822958 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c5cba-891c-4672-ac87-0fcb9bdc2569 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:47.831100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1223/2405] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:47 2022] DELETE /identity/v3/projects/70cd461a6c2f4a1bb4b81407befd5058 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:47.837167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c5cba-891c-4672-ac87-0fcb9bdc2569 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:47.846716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:47.926506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:47.927534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:47.927921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:47.928241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] PATH_INFO: `/v3/users/7875897b0c8d44719ae8745a0d2fbad6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:47.929881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7875897b0c8d44719ae8745a0d2fbad6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:47.932322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:48.007911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7875897b0c8d44719ae8745a0d2fbad6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.008603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7875897b0c8d44719ae8745a0d2fbad6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.017198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7875897b0c8d44719ae8745a0d2fbad6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.017926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7875897b0c8d44719ae8745a0d2fbad6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.027920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-b7c9b7a2-bc0e-460f-ac35-a92f7fc3bda6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7875897b0c8d44719ae8745a0d2fbad6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.051658 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1183/2406] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:47 2022] DELETE /identity/v3/users/7875897b0c8d44719ae8745a0d2fbad6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:48.464830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:48.471710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:48.506378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7390b-3301-4069-bb15-1ac8f16bbbeb admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:48.571203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:48.572120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:48.573013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:48.573013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] PATH_INFO: `/v3/projects/c89e79855ac84e39a3946c93fbce6db3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:48.573941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89e79855ac84e39a3946c93fbce6db3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:48.575892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:48.638327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89e79855ac84e39a3946c93fbce6db3', 'request_id': 'req-445475be-349a-4c04-97a4-39c73248b551'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.642708 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:48.648530 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89e79855ac84e39a3946c93fbce6db3', 'request_id': 'req-445475be-349a-4c04-97a4-39c73248b551'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.660161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89e79855ac84e39a3946c93fbce6db3', 'request_id': 'req-445475be-349a-4c04-97a4-39c73248b551'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.675952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] The token cache is being invalidate because project c89e79855ac84e39a3946c93fbce6db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:48.676300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.676910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-445475be-349a-4c04-97a4-39c73248b551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:48.678765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1224/2407] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:48 2022] DELETE /identity/v3/projects/c89e79855ac84e39a3946c93fbce6db3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:48.683363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25410d55-47ce-4868-b0fb-303e91979b6b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:48.683849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25410d55-47ce-4868-b0fb-303e91979b6b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:48.683993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25410d55-47ce-4868-b0fb-303e91979b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:48.703887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-25410d55-47ce-4868-b0fb-303e91979b6b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:48.705493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-25410d55-47ce-4868-b0fb-303e91979b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:48.786099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1184/2408] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:48.795710 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27900c1f-2d2f-4b36-85a6-6d59eba4724d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:48.796232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27900c1f-2d2f-4b36-85a6-6d59eba4724d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:48.796232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27900c1f-2d2f-4b36-85a6-6d59eba4724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:48.816272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-27900c1f-2d2f-4b36-85a6-6d59eba4724d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:48.817698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-27900c1f-2d2f-4b36-85a6-6d59eba4724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:48.826701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1225/2409] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:48.831400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25410d55-47ce-4868-b0fb-303e91979b6b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:48.841771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25410d55-47ce-4868-b0fb-303e91979b6b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:48.847085 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92149114-5cc6-48d3-a566-bd9f2b6b4908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:48.847837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149114-5cc6-48d3-a566-bd9f2b6b4908 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:48.848124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149114-5cc6-48d3-a566-bd9f2b6b4908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:48.848401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149114-5cc6-48d3-a566-bd9f2b6b4908 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:48.849139 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92149114-5cc6-48d3-a566-bd9f2b6b4908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:26:48.849448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92149114-5cc6-48d3-a566-bd9f2b6b4908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:48.851041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92149114-5cc6-48d3-a566-bd9f2b6b4908 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:48.863210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1185/2410] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:26:48.867680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27900c1f-2d2f-4b36-85a6-6d59eba4724d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:48.877688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27900c1f-2d2f-4b36-85a6-6d59eba4724d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:48.882279 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eb47f-b70c-4bbb-a467-5e50faf843ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:48.882938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eb47f-b70c-4bbb-a467-5e50faf843ad admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:48.883217 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eb47f-b70c-4bbb-a467-5e50faf843ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:48.883555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eb47f-b70c-4bbb-a467-5e50faf843ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:48.884253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6eb47f-b70c-4bbb-a467-5e50faf843ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:48.886180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6eb47f-b70c-4bbb-a467-5e50faf843ad admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:48.915434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1226/2411] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:26:48 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:48.919317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92149114-5cc6-48d3-a566-bd9f2b6b4908 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:48.929668 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92149114-5cc6-48d3-a566-bd9f2b6b4908 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:48.943471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:48.993829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67362e19-cc32-455f-878f-8e0418d6529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:48.994517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67362e19-cc32-455f-878f-8e0418d6529c admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:48.994806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67362e19-cc32-455f-878f-8e0418d6529c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:48.995105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67362e19-cc32-455f-878f-8e0418d6529c admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:48.995846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67362e19-cc32-455f-878f-8e0418d6529c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:48.997799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67362e19-cc32-455f-878f-8e0418d6529c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.024913 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1186/2412] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:26:48 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:49.029005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eb47f-b70c-4bbb-a467-5e50faf843ad admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.039988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eb47f-b70c-4bbb-a467-5e50faf843ad admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.044626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5cb23-908a-4999-8a07-852cb6adab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.045290 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5cb23-908a-4999-8a07-852cb6adab52 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.045572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5cb23-908a-4999-8a07-852cb6adab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.045897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5cb23-908a-4999-8a07-852cb6adab52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.046577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5cb23-908a-4999-8a07-852cb6adab52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.048973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5cb23-908a-4999-8a07-852cb6adab52 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.060655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1227/2413] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:49.065109 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67362e19-cc32-455f-878f-8e0418d6529c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.075122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67362e19-cc32-455f-878f-8e0418d6529c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.080272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a68551-59ab-4fe1-8c3e-0320eb45389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.080962 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68551-59ab-4fe1-8c3e-0320eb45389b admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.081243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68551-59ab-4fe1-8c3e-0320eb45389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.081519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a68551-59ab-4fe1-8c3e-0320eb45389b admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.082250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a68551-59ab-4fe1-8c3e-0320eb45389b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.083957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a68551-59ab-4fe1-8c3e-0320eb45389b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.094895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1187/2414] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:49.099553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5cb23-908a-4999-8a07-852cb6adab52 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.110772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5cb23-908a-4999-8a07-852cb6adab52 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.115460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ff13-9754-4f50-99d7-681dcbc188ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.116343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ff13-9754-4f50-99d7-681dcbc188ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.116625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ff13-9754-4f50-99d7-681dcbc188ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.116900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ff13-9754-4f50-99d7-681dcbc188ed admin admin] PATH_INFO: `/v3/projects/0d8c941b151f40aea07fcf75c6508d32/users/036ee29faddb412a850eec4321a062bf/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.132711 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455ff13-9754-4f50-99d7-681dcbc188ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8c941b151f40aea07fcf75c6508d32, user_id=036ee29faddb412a850eec4321a062bf, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.135786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455ff13-9754-4f50-99d7-681dcbc188ed admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.149294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1228/2415] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:49 2022] PUT /identity/v3/projects/0d8c941b151f40aea07fcf75c6508d32/users/036ee29faddb412a850eec4321a062bf/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:49.160589 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66f64-dd82-4498-b1eb-4a4630007562 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.160895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66f64-dd82-4498-b1eb-4a4630007562 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.161215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a66f64-dd82-4498-b1eb-4a4630007562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.190467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-11a66f64-dd82-4498-b1eb-4a4630007562 None None] MFA Rules not processed for user `036ee29faddb412a850eec4321a062bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:49.191709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-11a66f64-dd82-4498-b1eb-4a4630007562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:49.260817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1188/2416] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:49.265539 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ff13-9754-4f50-99d7-681dcbc188ed admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.335406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ff13-9754-4f50-99d7-681dcbc188ed admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.340598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e4c97-8e21-4b38-8344-32ca0c3932e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.341374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e4c97-8e21-4b38-8344-32ca0c3932e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.341647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e4c97-8e21-4b38-8344-32ca0c3932e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.341932 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e4c97-8e21-4b38-8344-32ca0c3932e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.342700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e4c97-8e21-4b38-8344-32ca0c3932e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.345391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e4c97-8e21-4b38-8344-32ca0c3932e9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.373663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1229/2417] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:26:49 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:49.377767 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66f64-dd82-4498-b1eb-4a4630007562 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.390555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a66f64-dd82-4498-b1eb-4a4630007562 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.475604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9d65b-7d6d-4f76-baeb-661f98c7d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.476440 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9d65b-7d6d-4f76-baeb-661f98c7d279 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.476823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9d65b-7d6d-4f76-baeb-661f98c7d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.477198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9d65b-7d6d-4f76-baeb-661f98c7d279 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.478535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9d65b-7d6d-4f76-baeb-661f98c7d279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.483192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9d65b-7d6d-4f76-baeb-661f98c7d279 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.510043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1189/2418] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:26:49 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:49.511306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e4c97-8e21-4b38-8344-32ca0c3932e9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.525815 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e4c97-8e21-4b38-8344-32ca0c3932e9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.532499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d9ed-ec54-4779-b083-c8183788399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.533192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d9ed-ec54-4779-b083-c8183788399c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.533696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d9ed-ec54-4779-b083-c8183788399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.533966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310d9ed-ec54-4779-b083-c8183788399c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.534756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310d9ed-ec54-4779-b083-c8183788399c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.536467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310d9ed-ec54-4779-b083-c8183788399c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.558483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1230/2419] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:49.561987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9d65b-7d6d-4f76-baeb-661f98c7d279 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.583230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9d65b-7d6d-4f76-baeb-661f98c7d279 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.588935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca59a0-65dc-4d7e-a21a-9f36a999d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.589767 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca59a0-65dc-4d7e-a21a-9f36a999d088 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.590049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca59a0-65dc-4d7e-a21a-9f36a999d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.590334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca59a0-65dc-4d7e-a21a-9f36a999d088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.591106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca59a0-65dc-4d7e-a21a-9f36a999d088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.592827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca59a0-65dc-4d7e-a21a-9f36a999d088 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.603812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d9ed-ec54-4779-b083-c8183788399c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.605700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e310d9ed-ec54-4779-b083-c8183788399c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:49.617802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1190/2420] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:26:49.628029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca59a0-65dc-4d7e-a21a-9f36a999d088 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.634651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:49.643005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca59a0-65dc-4d7e-a21a-9f36a999d088 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.650911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51f006-eba4-4211-b9f8-f84d1e244196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.651851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51f006-eba4-4211-b9f8-f84d1e244196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.652318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51f006-eba4-4211-b9f8-f84d1e244196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.652441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51f006-eba4-4211-b9f8-f84d1e244196 admin admin] PATH_INFO: `/v3/projects/7b391d1af1c242399cd37f8e7be67b28/users/c1781444036b49d4bbc6349f9e58ab1a/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.680073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51f006-eba4-4211-b9f8-f84d1e244196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b391d1af1c242399cd37f8e7be67b28, user_id=c1781444036b49d4bbc6349f9e58ab1a, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.683084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310d9ed-ec54-4779-b083-c8183788399c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.685681 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51f006-eba4-4211-b9f8-f84d1e244196 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.691050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c56e25-edd8-4a59-9685-de05aaa3eb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.691946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c56e25-edd8-4a59-9685-de05aaa3eb42 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.692381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c56e25-edd8-4a59-9685-de05aaa3eb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.692804 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c56e25-edd8-4a59-9685-de05aaa3eb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.695408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-13c56e25-edd8-4a59-9685-de05aaa3eb42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:49.702069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:49.708419 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1191/2421] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:49 2022] PUT /identity/v3/projects/7b391d1af1c242399cd37f8e7be67b28/users/c1781444036b49d4bbc6349f9e58ab1a/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:26:49.720311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46eef9-32b9-436b-a078-feb6657be06a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.720908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46eef9-32b9-436b-a078-feb6657be06a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.721197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46eef9-32b9-436b-a078-feb6657be06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.754563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7c46eef9-32b9-436b-a078-feb6657be06a None None] MFA Rules not processed for user `c1781444036b49d4bbc6349f9e58ab1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:49.756000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7c46eef9-32b9-436b-a078-feb6657be06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:49.826305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c56e25-edd8-4a59-9685-de05aaa3eb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.828234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c56e25-edd8-4a59-9685-de05aaa3eb42 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.844809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1231/2422] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:26:49.846883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf77a6a-0098-4fff-8607-793e4ea71535 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.847361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf77a6a-0098-4fff-8607-793e4ea71535 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.847704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf77a6a-0098-4fff-8607-793e4ea71535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.856898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1192/2423] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:26:49.858100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46eef9-32b9-436b-a078-feb6657be06a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.869046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2cf77a6a-0098-4fff-8607-793e4ea71535 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:49.870532 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2cf77a6a-0098-4fff-8607-793e4ea71535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:49.978935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1232/2424] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:49.982566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46eef9-32b9-436b-a078-feb6657be06a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:49.990250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02a730-b007-4245-bd47-a8b4f1526589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:49.990480 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a730-b007-4245-bd47-a8b4f1526589 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:49.990685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a730-b007-4245-bd47-a8b4f1526589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:49.990961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02a730-b007-4245-bd47-a8b4f1526589 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:49.992200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02a730-b007-4245-bd47-a8b4f1526589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:49.994110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02a730-b007-4245-bd47-a8b4f1526589 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:49.995133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf77a6a-0098-4fff-8607-793e4ea71535 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:49.996643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2cf77a6a-0098-4fff-8607-793e4ea71535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:50.053293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1193/2425] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:26:49 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:26:50.057146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02a730-b007-4245-bd47-a8b4f1526589 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:50.111395 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf77a6a-0098-4fff-8607-793e4ea71535 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:50.128963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:50.136070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02a730-b007-4245-bd47-a8b4f1526589 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:50.142930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17525e66-d8fa-4511-af26-9b1cf53204a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:50.143898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17525e66-d8fa-4511-af26-9b1cf53204a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.144214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17525e66-d8fa-4511-af26-9b1cf53204a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.144553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17525e66-d8fa-4511-af26-9b1cf53204a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.146772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17525e66-d8fa-4511-af26-9b1cf53204a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:50.149691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17525e66-d8fa-4511-af26-9b1cf53204a7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:50.179265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1194/2426] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:26:50 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:26:50.180367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17525e66-d8fa-4511-af26-9b1cf53204a7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:50.193214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17525e66-d8fa-4511-af26-9b1cf53204a7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:50.198611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145c27d-7852-4783-ae37-0265532d8666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:50.199440 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145c27d-7852-4783-ae37-0265532d8666 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.199831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145c27d-7852-4783-ae37-0265532d8666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.200201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145c27d-7852-4783-ae37-0265532d8666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.201052 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145c27d-7852-4783-ae37-0265532d8666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:50.202750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145c27d-7852-4783-ae37-0265532d8666 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:50.204246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:50.224871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1195/2427] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:26:50.226199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145c27d-7852-4783-ae37-0265532d8666 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:50.237956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b3b1f-410d-4c53-9dc6-4a1dedaa4e32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:50.238886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b3b1f-410d-4c53-9dc6-4a1dedaa4e32 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.239238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b3b1f-410d-4c53-9dc6-4a1dedaa4e32 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.239562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145c27d-7852-4783-ae37-0265532d8666 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:50.239676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b3b1f-410d-4c53-9dc6-4a1dedaa4e32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.248429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab9b2-9186-41a5-b975-a5913386b7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:50.251169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab9b2-9186-41a5-b975-a5913386b7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.251570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab9b2-9186-41a5-b975-a5913386b7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.251979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab9b2-9186-41a5-b975-a5913386b7cc admin admin] PATH_INFO: `/v3/projects/1b11773f729046d6a0dc36483598efc9/users/d6c4bcd316d74b0bb0a4b01aac908362/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.276301 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab9b2-9186-41a5-b975-a5913386b7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b11773f729046d6a0dc36483598efc9, user_id=d6c4bcd316d74b0bb0a4b01aac908362, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:50.278953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab9b2-9186-41a5-b975-a5913386b7cc admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:50.299353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1196/2428] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:50 2022] PUT /identity/v3/projects/1b11773f729046d6a0dc36483598efc9/users/d6c4bcd316d74b0bb0a4b01aac908362/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:26:50.303672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab9b2-9186-41a5-b975-a5913386b7cc admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:50.315854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b3b1f-410d-4c53-9dc6-4a1dedaa4e32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:50.317671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b3b1f-410d-4c53-9dc6-4a1dedaa4e32 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:50.327392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1233/2429] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:26:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:26:50.416344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab9b2-9186-41a5-b975-a5913386b7cc admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:50.422170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e94277-c9bf-456e-bf09-68ec4bf02d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:50.423714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e94277-c9bf-456e-bf09-68ec4bf02d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.425384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e94277-c9bf-456e-bf09-68ec4bf02d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.425384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e94277-c9bf-456e-bf09-68ec4bf02d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.425384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e94277-c9bf-456e-bf09-68ec4bf02d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:50.428055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e94277-c9bf-456e-bf09-68ec4bf02d36 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:50.447157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1197/2430] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:26:50.453684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b3b1f-410d-4c53-9dc6-4a1dedaa4e32 service swift] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:50.466715 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b3b1f-410d-4c53-9dc6-4a1dedaa4e32 service swift] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:50.472814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67ec04-b9d6-4222-ac8a-1f2f17868e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:50.473717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ec04-b9d6-4222-ac8a-1f2f17868e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.474016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ec04-b9d6-4222-ac8a-1f2f17868e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.474284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ec04-b9d6-4222-ac8a-1f2f17868e8e admin admin] PATH_INFO: `/v3/projects/1b11773f729046d6a0dc36483598efc9/users/d6c4bcd316d74b0bb0a4b01aac908362/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.477452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67ec04-b9d6-4222-ac8a-1f2f17868e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b11773f729046d6a0dc36483598efc9, user_id=d6c4bcd316d74b0bb0a4b01aac908362, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:50.483705 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67ec04-b9d6-4222-ac8a-1f2f17868e8e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:50.502966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1234/2431] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:26:50 2022] PUT /identity/v3/projects/1b11773f729046d6a0dc36483598efc9/users/d6c4bcd316d74b0bb0a4b01aac908362/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:50.513407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43313f45-6a48-4359-a656-9b44614639a6 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.513840 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43313f45-6a48-4359-a656-9b44614639a6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.514221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43313f45-6a48-4359-a656-9b44614639a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.560560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-43313f45-6a48-4359-a656-9b44614639a6 None None] MFA Rules not processed for user `d6c4bcd316d74b0bb0a4b01aac908362`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:50.561907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-43313f45-6a48-4359-a656-9b44614639a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:50.576854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4dbfc-52f6-4fce-9a82-92145b593f53 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.577099 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4dbfc-52f6-4fce-9a82-92145b593f53 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.577246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4dbfc-52f6-4fce-9a82-92145b593f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.598255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0de4dbfc-52f6-4fce-9a82-92145b593f53 None None] MFA Rules not processed for user `05ba6d637a31453b88ba4c18b47697b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:50.600323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0de4dbfc-52f6-4fce-9a82-92145b593f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:50.664100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1198/2432] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:50.674761 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1235/2433] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:50.675757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43313f45-6a48-4359-a656-9b44614639a6 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:50.677208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-43313f45-6a48-4359-a656-9b44614639a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:50.717225 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4dbfc-52f6-4fce-9a82-92145b593f53 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:50.717928 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:50.719564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0de4dbfc-52f6-4fce-9a82-92145b593f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:50.747199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43313f45-6a48-4359-a656-9b44614639a6 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:50.754203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22331b7b-6830-4e80-b576-457e4d1dd894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:50.755321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22331b7b-6830-4e80-b576-457e4d1dd894 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.756171 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22331b7b-6830-4e80-b576-457e4d1dd894 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.756631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22331b7b-6830-4e80-b576-457e4d1dd894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.822819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4dbfc-52f6-4fce-9a82-92145b593f53 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:50.826695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c68c4e-f3bd-465a-8ecb-ecbe8beaccf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a418c5817e784d299c8d6daad20c6cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:50.827411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c68c4e-f3bd-465a-8ecb-ecbe8beaccf9 service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:50.827658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c68c4e-f3bd-465a-8ecb-ecbe8beaccf9 service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:50.827933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c68c4e-f3bd-465a-8ecb-ecbe8beaccf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:50.830359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d5c68c4e-f3bd-465a-8ecb-ecbe8beaccf9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:50.832189 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22331b7b-6830-4e80-b576-457e4d1dd894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:50.834328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22331b7b-6830-4e80-b576-457e4d1dd894 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:50.837161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:50.850250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1199/2434] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:26:50.914642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c68c4e-f3bd-465a-8ecb-ecbe8beaccf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:50.916032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c68c4e-f3bd-465a-8ecb-ecbe8beaccf9 service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:50.928947 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1236/2435] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:26:52.659644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22331b7b-6830-4e80-b576-457e4d1dd894 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:52.661117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-22331b7b-6830-4e80-b576-457e4d1dd894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:52.674149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22331b7b-6830-4e80-b576-457e4d1dd894 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:52.678131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22190709-099d-4414-9f52-e2da3753ecd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:52.678864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22190709-099d-4414-9f52-e2da3753ecd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:52.679266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22190709-099d-4414-9f52-e2da3753ecd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:52.679649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22190709-099d-4414-9f52-e2da3753ecd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:52.754130 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22190709-099d-4414-9f52-e2da3753ecd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:52.755910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22190709-099d-4414-9f52-e2da3753ecd1 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:52.767360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1200/2436] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:53.566818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c68c4e-f3bd-465a-8ecb-ecbe8beaccf9 service glance] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:53.577968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c68c4e-f3bd-465a-8ecb-ecbe8beaccf9 service glance] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:53.582908 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac09b1c-1841-47cc-ba27-bdcf6546a261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:53.583803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac09b1c-1841-47cc-ba27-bdcf6546a261 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:53.584198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac09b1c-1841-47cc-ba27-bdcf6546a261 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:53.584582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac09b1c-1841-47cc-ba27-bdcf6546a261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:53.595211 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac09b1c-1841-47cc-ba27-bdcf6546a261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:53.596891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac09b1c-1841-47cc-ba27-bdcf6546a261 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:53.608335 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1237/2437] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:57.972214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22190709-099d-4414-9f52-e2da3753ecd1 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:58.103836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22190709-099d-4414-9f52-e2da3753ecd1 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:58.109212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:58.110222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:58.110625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:58.110987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] PATH_INFO: `/v3/users/036ee29faddb412a850eec4321a062bf` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:58.112377 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036ee29faddb412a850eec4321a062bf)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:58.115600 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:58.183777 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:58.224552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036ee29faddb412a850eec4321a062bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:58.225468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036ee29faddb412a850eec4321a062bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:58.235310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036ee29faddb412a850eec4321a062bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:58.238865 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036ee29faddb412a850eec4321a062bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:58.249290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036ee29faddb412a850eec4321a062bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:58.279772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1201/2438] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:57 2022] DELETE /identity/v3/users/036ee29faddb412a850eec4321a062bf => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:58.284974 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074e76-7aca-40ae-8769-e4d2eaac2d0c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:58.285812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074e76-7aca-40ae-8769-e4d2eaac2d0c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:58.286097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f074e76-7aca-40ae-8769-e4d2eaac2d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:58.327300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9f074e76-7aca-40ae-8769-e4d2eaac2d0c None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:26:58.331928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9f074e76-7aca-40ae-8769-e4d2eaac2d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:58.447952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1238/2439] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:26:58.458111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:58.460000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:58.548159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafd7b2-3404-4a93-a47d-2fe1ecd7d500 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:58.557245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51738e-6152-434a-b018-bfbc2b53795b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:58.558563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51738e-6152-434a-b018-bfbc2b53795b service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:58.558956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51738e-6152-434a-b018-bfbc2b53795b service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:58.559635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51738e-6152-434a-b018-bfbc2b53795b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:58.575495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51738e-6152-434a-b018-bfbc2b53795b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:58.577212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51738e-6152-434a-b018-bfbc2b53795b service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:58.589248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1202/2440] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:26:58.987501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f074e76-7aca-40ae-8769-e4d2eaac2d0c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:58.989216 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9f074e76-7aca-40ae-8769-e4d2eaac2d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:59.037696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f074e76-7aca-40ae-8769-e4d2eaac2d0c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:59.044092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:59.045241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:59.045685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:59.046125 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] PATH_INFO: `/v3/projects/0d8c941b151f40aea07fcf75c6508d32` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:59.048113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8c941b151f40aea07fcf75c6508d32)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:59.050238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:59.110441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8c941b151f40aea07fcf75c6508d32', 'request_id': 'req-94b72703-598e-4aa3-bbec-e99e9b750eb4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.120146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8c941b151f40aea07fcf75c6508d32', 'request_id': 'req-94b72703-598e-4aa3-bbec-e99e9b750eb4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.131171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8c941b151f40aea07fcf75c6508d32', 'request_id': 'req-94b72703-598e-4aa3-bbec-e99e9b750eb4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.143356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] The token cache is being invalidate because project 0d8c941b151f40aea07fcf75c6508d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:26:59.143823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.144512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.148964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1239/2441] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:58 2022] DELETE /identity/v3/projects/0d8c941b151f40aea07fcf75c6508d32 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:59.150158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51738e-6152-434a-b018-bfbc2b53795b service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:59.161693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51738e-6152-434a-b018-bfbc2b53795b service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:59.242912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:59.243898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:59.244148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:59.244426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] PATH_INFO: `/v3/users/c1781444036b49d4bbc6349f9e58ab1a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:59.245686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1781444036b49d4bbc6349f9e58ab1a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:59.247963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:59.308028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1781444036b49d4bbc6349f9e58ab1a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.309295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1781444036b49d4bbc6349f9e58ab1a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.310648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:59.334698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1781444036b49d4bbc6349f9e58ab1a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.335760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1781444036b49d4bbc6349f9e58ab1a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.347953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1781444036b49d4bbc6349f9e58ab1a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.373091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1203/2442] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:26:59 2022] DELETE /identity/v3/users/c1781444036b49d4bbc6349f9e58ab1a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:26:59.748221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:26:59.749823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:26:59.766727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:26:59.771032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b72703-598e-4aa3-bbec-e99e9b750eb4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:26:59.854814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:26:59.856256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:26:59.856572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:26:59.856942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] PATH_INFO: `/v3/projects/7b391d1af1c242399cd37f8e7be67b28` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:26:59.859065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b391d1af1c242399cd37f8e7be67b28)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:26:59.863316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:26:59.936701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b391d1af1c242399cd37f8e7be67b28', 'request_id': 'req-f419f9c3-65d8-4153-8eec-2898c316c303'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.949364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b391d1af1c242399cd37f8e7be67b28', 'request_id': 'req-f419f9c3-65d8-4153-8eec-2898c316c303'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.961028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b391d1af1c242399cd37f8e7be67b28', 'request_id': 'req-f419f9c3-65d8-4153-8eec-2898c316c303'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:26:59.999968 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] The token cache is being invalidate because project 7b391d1af1c242399cd37f8e7be67b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:00.000190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.002992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.005283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1240/2443] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:26:59 2022] DELETE /identity/v3/projects/7b391d1af1c242399cd37f8e7be67b28 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:00.009488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:00.011506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:00.035782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce354fa-305e-417e-b4bf-8ff1aebd822b admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:00.176469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:00.180024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:00.180024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:00.180024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] PATH_INFO: `/v3/users/d6c4bcd316d74b0bb0a4b01aac908362` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:00.180699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c4bcd316d74b0bb0a4b01aac908362)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:00.182676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:00.274569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c4bcd316d74b0bb0a4b01aac908362'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.276198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c4bcd316d74b0bb0a4b01aac908362'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.288170 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c4bcd316d74b0bb0a4b01aac908362'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.289851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c4bcd316d74b0bb0a4b01aac908362'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.309938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-23847608-6822-4ea9-bbf8-975790fec602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c4bcd316d74b0bb0a4b01aac908362'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.366522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1204/2444] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:00 2022] DELETE /identity/v3/users/d6c4bcd316d74b0bb0a4b01aac908362 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:00.711924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:00.713503 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:00.729812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419f9c3-65d8-4153-8eec-2898c316c303 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:00.806559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:00.807376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:00.807663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:00.807935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] PATH_INFO: `/v3/projects/1b11773f729046d6a0dc36483598efc9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:00.809182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b11773f729046d6a0dc36483598efc9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:00.811114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:00.852977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:00.869431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b11773f729046d6a0dc36483598efc9', 'request_id': 'req-31e42935-69c6-4d5d-acbd-2143a44ce939'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.879580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b11773f729046d6a0dc36483598efc9', 'request_id': 'req-31e42935-69c6-4d5d-acbd-2143a44ce939'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.889731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b11773f729046d6a0dc36483598efc9', 'request_id': 'req-31e42935-69c6-4d5d-acbd-2143a44ce939'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.904742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] The token cache is being invalidate because project 1b11773f729046d6a0dc36483598efc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:00.905032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.905703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-31e42935-69c6-4d5d-acbd-2143a44ce939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:00.907585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1241/2445] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:00 2022] DELETE /identity/v3/projects/1b11773f729046d6a0dc36483598efc9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:00.912274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb313246-3dd9-4167-9aa5-8386129fa7ab None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:00.912565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb313246-3dd9-4167-9aa5-8386129fa7ab None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:00.912846 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb313246-3dd9-4167-9aa5-8386129fa7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:00.932963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-eb313246-3dd9-4167-9aa5-8386129fa7ab None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:00.934385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eb313246-3dd9-4167-9aa5-8386129fa7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:00.982810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:01.003685 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1205/2446] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:01.012482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8ed9-25b1-4842-b57d-9715db8ae5e5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.012791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8ed9-25b1-4842-b57d-9715db8ae5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.013046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8ed9-25b1-4842-b57d-9715db8ae5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.035725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-519f8ed9-25b1-4842-b57d-9715db8ae5e5 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:01.039294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-519f8ed9-25b1-4842-b57d-9715db8ae5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:01.047059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1242/2447] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:01.054227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb313246-3dd9-4167-9aa5-8386129fa7ab None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:01.072514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb313246-3dd9-4167-9aa5-8386129fa7ab None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:01.077799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3c058-10af-4bb2-b4b1-0aca64d7d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:01.078983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3c058-10af-4bb2-b4b1-0aca64d7d40d admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.079271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3c058-10af-4bb2-b4b1-0aca64d7d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.079578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3c058-10af-4bb2-b4b1-0aca64d7d40d admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.080316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3c058-10af-4bb2-b4b1-0aca64d7d40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:27:01.080624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3c058-10af-4bb2-b4b1-0aca64d7d40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:01.082513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3c058-10af-4bb2-b4b1-0aca64d7d40d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:01.106563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1206/2448] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:27:01.107969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f8ed9-25b1-4842-b57d-9715db8ae5e5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:01.122801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f8ed9-25b1-4842-b57d-9715db8ae5e5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:01.133040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c5472-625c-43bd-9d23-8164c34ce6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:01.134089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c5472-625c-43bd-9d23-8164c34ce6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.134519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c5472-625c-43bd-9d23-8164c34ce6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.134946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c5472-625c-43bd-9d23-8164c34ce6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.135832 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c5472-625c-43bd-9d23-8164c34ce6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:01.137896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c5472-625c-43bd-9d23-8164c34ce6b1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:01.179386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1243/2449] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:01 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:01.180999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3c058-10af-4bb2-b4b1-0aca64d7d40d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:01.204584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3c058-10af-4bb2-b4b1-0aca64d7d40d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:01.285016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20abcfc-2d38-4c16-809d-c68bdc49df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:01.285748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20abcfc-2d38-4c16-809d-c68bdc49df8b admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.286039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20abcfc-2d38-4c16-809d-c68bdc49df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.286351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20abcfc-2d38-4c16-809d-c68bdc49df8b admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.287216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20abcfc-2d38-4c16-809d-c68bdc49df8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:01.289408 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20abcfc-2d38-4c16-809d-c68bdc49df8b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:01.323761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1207/2450] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:01 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:01.325678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c5472-625c-43bd-9d23-8164c34ce6b1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:01.342954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c5472-625c-43bd-9d23-8164c34ce6b1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:01.354945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8757e9-daa8-4cbd-95ae-c7a6ac38c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:01.356190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8757e9-daa8-4cbd-95ae-c7a6ac38c8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.356825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8757e9-daa8-4cbd-95ae-c7a6ac38c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.357297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8757e9-daa8-4cbd-95ae-c7a6ac38c8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.358641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8757e9-daa8-4cbd-95ae-c7a6ac38c8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:01.363838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8757e9-daa8-4cbd-95ae-c7a6ac38c8f4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:01.384528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1244/2451] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:01.388636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20abcfc-2d38-4c16-809d-c68bdc49df8b admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:01.409788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20abcfc-2d38-4c16-809d-c68bdc49df8b admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:01.414848 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da6d32-129b-4ab3-9c55-c0d1af5aab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:01.415555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da6d32-129b-4ab3-9c55-c0d1af5aab7a admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.415842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da6d32-129b-4ab3-9c55-c0d1af5aab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.416128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da6d32-129b-4ab3-9c55-c0d1af5aab7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.416871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da6d32-129b-4ab3-9c55-c0d1af5aab7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:01.418464 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da6d32-129b-4ab3-9c55-c0d1af5aab7a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:01.451691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1208/2452] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:01.455514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8757e9-daa8-4cbd-95ae-c7a6ac38c8f4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:01.501197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8757e9-daa8-4cbd-95ae-c7a6ac38c8f4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:01.506420 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a532e-0be2-417e-b474-1724d2fe0697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:01.507317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a532e-0be2-417e-b474-1724d2fe0697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.507771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a532e-0be2-417e-b474-1724d2fe0697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.507885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a532e-0be2-417e-b474-1724d2fe0697 admin admin] PATH_INFO: `/v3/projects/b52ad4eab09042658bf03332c5dff12f/users/2e518da9d22342a0bee9fb583b43ef7f/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.540114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a532e-0be2-417e-b474-1724d2fe0697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52ad4eab09042658bf03332c5dff12f, user_id=2e518da9d22342a0bee9fb583b43ef7f, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:01.542840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a532e-0be2-417e-b474-1724d2fe0697 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:01.571425 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1245/2453] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:01 2022] PUT /identity/v3/projects/b52ad4eab09042658bf03332c5dff12f/users/2e518da9d22342a0bee9fb583b43ef7f/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:01.638332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d708e65-071b-469c-a7fe-ef3e222b795b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.638629 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d708e65-071b-469c-a7fe-ef3e222b795b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.638912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d708e65-071b-469c-a7fe-ef3e222b795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.673155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4d708e65-071b-469c-a7fe-ef3e222b795b None None] MFA Rules not processed for user `2e518da9d22342a0bee9fb583b43ef7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:01.674396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4d708e65-071b-469c-a7fe-ef3e222b795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:01.758024 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1209/2454] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:01.764139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a532e-0be2-417e-b474-1724d2fe0697 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:01.852462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a532e-0be2-417e-b474-1724d2fe0697 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:01.858930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469e727-35b1-4696-bb10-ace2482ec0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:01.860231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469e727-35b1-4696-bb10-ace2482ec0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.860519 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469e727-35b1-4696-bb10-ace2482ec0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.860793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469e727-35b1-4696-bb10-ace2482ec0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.861538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469e727-35b1-4696-bb10-ace2482ec0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:01.863433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469e727-35b1-4696-bb10-ace2482ec0e0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:01.894740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1246/2455] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:01 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:27:01.898941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d708e65-071b-469c-a7fe-ef3e222b795b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:01.911059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d708e65-071b-469c-a7fe-ef3e222b795b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:01.949541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:01.970065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebc19b-1e89-4a80-86aa-3342f63dd139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:01.970745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebc19b-1e89-4a80-86aa-3342f63dd139 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:01.971986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebc19b-1e89-4a80-86aa-3342f63dd139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:01.972622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebc19b-1e89-4a80-86aa-3342f63dd139 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:01.973705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebc19b-1e89-4a80-86aa-3342f63dd139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:01.975682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebc19b-1e89-4a80-86aa-3342f63dd139 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.003695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1210/2456] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:01 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:27:02.003838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469e727-35b1-4696-bb10-ace2482ec0e0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.014681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469e727-35b1-4696-bb10-ace2482ec0e0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.020219 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df76c9-3f45-40ba-8ad6-7cc0010b7ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.021059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df76c9-3f45-40ba-8ad6-7cc0010b7ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.021352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df76c9-3f45-40ba-8ad6-7cc0010b7ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.021631 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df76c9-3f45-40ba-8ad6-7cc0010b7ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.022371 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df76c9-3f45-40ba-8ad6-7cc0010b7ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.024155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df76c9-3f45-40ba-8ad6-7cc0010b7ff2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.036510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1247/2457] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:27:02.040730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebc19b-1e89-4a80-86aa-3342f63dd139 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.055235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebc19b-1e89-4a80-86aa-3342f63dd139 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.060511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ec70f-7410-4d27-92c3-3a4bbf4afcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.061268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec70f-7410-4d27-92c3-3a4bbf4afcda admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.061693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec70f-7410-4d27-92c3-3a4bbf4afcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.062072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ec70f-7410-4d27-92c3-3a4bbf4afcda admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.062872 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec70f-7410-4d27-92c3-3a4bbf4afcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.065084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ec70f-7410-4d27-92c3-3a4bbf4afcda admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.075655 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1211/2458] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:27:02.080418 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df76c9-3f45-40ba-8ad6-7cc0010b7ff2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.090237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df76c9-3f45-40ba-8ad6-7cc0010b7ff2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.095876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f250d-b75c-4b4a-934f-c87067405e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.096758 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f250d-b75c-4b4a-934f-c87067405e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.097044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f250d-b75c-4b4a-934f-c87067405e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.097325 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f250d-b75c-4b4a-934f-c87067405e7e admin admin] PATH_INFO: `/v3/projects/cb36b2af7f844ab0b6c2ea27f0311b3b/users/b658c247884947e5872a6eafb61b793b/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.111765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f250d-b75c-4b4a-934f-c87067405e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb36b2af7f844ab0b6c2ea27f0311b3b, user_id=b658c247884947e5872a6eafb61b793b, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.114404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f250d-b75c-4b4a-934f-c87067405e7e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.127699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1248/2459] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:02 2022] PUT /identity/v3/projects/cb36b2af7f844ab0b6c2ea27f0311b3b/users/b658c247884947e5872a6eafb61b793b/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:02.139687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ecbed-07f8-4ce4-849b-0be41f388451 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.139983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ecbed-07f8-4ce4-849b-0be41f388451 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.141826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ecbed-07f8-4ce4-849b-0be41f388451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.170264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e07ecbed-07f8-4ce4-849b-0be41f388451 None None] MFA Rules not processed for user `b658c247884947e5872a6eafb61b793b`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:02.171506 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e07ecbed-07f8-4ce4-849b-0be41f388451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:02.240099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1212/2460] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:02.244603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f250d-b75c-4b4a-934f-c87067405e7e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.257729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:02.310028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f250d-b75c-4b4a-934f-c87067405e7e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.314987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599323a-5059-4929-9733-c8e987b006f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.315726 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599323a-5059-4929-9733-c8e987b006f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.316013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599323a-5059-4929-9733-c8e987b006f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.316297 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599323a-5059-4929-9733-c8e987b006f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.317071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599323a-5059-4929-9733-c8e987b006f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.319007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599323a-5059-4929-9733-c8e987b006f6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.350013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1249/2461] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:02 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:02.354760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ecbed-07f8-4ce4-849b-0be41f388451 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.365815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ecbed-07f8-4ce4-849b-0be41f388451 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.423433 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5600-1289-4eb8-89db-01abc40dd61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.424073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5600-1289-4eb8-89db-01abc40dd61a admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.424359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5600-1289-4eb8-89db-01abc40dd61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.424638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd5600-1289-4eb8-89db-01abc40dd61a admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.425465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5600-1289-4eb8-89db-01abc40dd61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.427421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd5600-1289-4eb8-89db-01abc40dd61a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.449168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1213/2462] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:02 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:02.453704 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599323a-5059-4929-9733-c8e987b006f6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.464538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599323a-5059-4929-9733-c8e987b006f6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.469344 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40508dcd-26b1-4ec3-84af-ab98a15980e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.470009 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40508dcd-26b1-4ec3-84af-ab98a15980e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.470296 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40508dcd-26b1-4ec3-84af-ab98a15980e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.470578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40508dcd-26b1-4ec3-84af-ab98a15980e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.471308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40508dcd-26b1-4ec3-84af-ab98a15980e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.472946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40508dcd-26b1-4ec3-84af-ab98a15980e6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.483700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1250/2463] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:02.487898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5600-1289-4eb8-89db-01abc40dd61a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.498110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd5600-1289-4eb8-89db-01abc40dd61a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.503301 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74956e8-81f2-40ea-aa82-6d4584fc0941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.504212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74956e8-81f2-40ea-aa82-6d4584fc0941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.504497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74956e8-81f2-40ea-aa82-6d4584fc0941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.504774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74956e8-81f2-40ea-aa82-6d4584fc0941 admin admin] PATH_INFO: `/v3/projects/3ef055098a214b4c85d268cf5339a88a/users/4d1e94fb12ec4d78abcd4d66f69175f1/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.520380 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74956e8-81f2-40ea-aa82-6d4584fc0941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef055098a214b4c85d268cf5339a88a, user_id=4d1e94fb12ec4d78abcd4d66f69175f1, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.523017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74956e8-81f2-40ea-aa82-6d4584fc0941 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.536447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1214/2464] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:02 2022] PUT /identity/v3/projects/3ef055098a214b4c85d268cf5339a88a/users/4d1e94fb12ec4d78abcd4d66f69175f1/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:02.540348 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40508dcd-26b1-4ec3-84af-ab98a15980e6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.550206 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40508dcd-26b1-4ec3-84af-ab98a15980e6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.608114 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86cdd5-4695-4465-8017-6b83ff19c218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.608788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86cdd5-4695-4465-8017-6b83ff19c218 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.609075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86cdd5-4695-4465-8017-6b83ff19c218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.609354 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86cdd5-4695-4465-8017-6b83ff19c218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.610117 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86cdd5-4695-4465-8017-6b83ff19c218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.611901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86cdd5-4695-4465-8017-6b83ff19c218 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.621894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1251/2465] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:02.626357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74956e8-81f2-40ea-aa82-6d4584fc0941 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.636424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74956e8-81f2-40ea-aa82-6d4584fc0941 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.641673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9f584-7973-4895-94e1-beabaecabe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.642660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9f584-7973-4895-94e1-beabaecabe30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.642944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9f584-7973-4895-94e1-beabaecabe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.643244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9f584-7973-4895-94e1-beabaecabe30 admin admin] PATH_INFO: `/v3/projects/3ef055098a214b4c85d268cf5339a88a/users/4d1e94fb12ec4d78abcd4d66f69175f1/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.645296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9f584-7973-4895-94e1-beabaecabe30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef055098a214b4c85d268cf5339a88a, user_id=4d1e94fb12ec4d78abcd4d66f69175f1, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.647935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9f584-7973-4895-94e1-beabaecabe30 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.654334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:02.660332 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1215/2466] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:02 2022] PUT /identity/v3/projects/3ef055098a214b4c85d268cf5339a88a/users/4d1e94fb12ec4d78abcd4d66f69175f1/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:02.670544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521bb30-9dbb-4319-804f-3991736fd901 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.671193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521bb30-9dbb-4319-804f-3991736fd901 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.671459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521bb30-9dbb-4319-804f-3991736fd901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.700820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2521bb30-9dbb-4319-804f-3991736fd901 None None] MFA Rules not processed for user `4d1e94fb12ec4d78abcd4d66f69175f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:02.702104 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2521bb30-9dbb-4319-804f-3991736fd901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:02.782284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1252/2467] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:02.794066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9f584-7973-4895-94e1-beabaecabe30 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:02.795859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-05d9f584-7973-4895-94e1-beabaecabe30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:02.884761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9f584-7973-4895-94e1-beabaecabe30 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:02.889273 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8773-f3f3-4f14-9197-0fda003c0745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:02.889929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8773-f3f3-4f14-9197-0fda003c0745 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:02.890250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8773-f3f3-4f14-9197-0fda003c0745 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:02.890529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f8773-f3f3-4f14-9197-0fda003c0745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:02.964178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f8773-f3f3-4f14-9197-0fda003c0745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:02.965752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f8773-f3f3-4f14-9197-0fda003c0745 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:02.976909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1216/2468] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:03.685076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521bb30-9dbb-4319-804f-3991736fd901 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:03.686857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2521bb30-9dbb-4319-804f-3991736fd901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:03.697422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:03.755157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521bb30-9dbb-4319-804f-3991736fd901 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:03.758848 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576c9e5-b954-4118-9c99-8338ce399e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:03.759647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576c9e5-b954-4118-9c99-8338ce399e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:03.760551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576c9e5-b954-4118-9c99-8338ce399e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:03.760551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576c9e5-b954-4118-9c99-8338ce399e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:03.762826 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a576c9e5-b954-4118-9c99-8338ce399e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:03.774665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576c9e5-b954-4118-9c99-8338ce399e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:03.776271 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576c9e5-b954-4118-9c99-8338ce399e49 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:03.785909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1253/2469] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:04.467323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8773-f3f3-4f14-9197-0fda003c0745 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:04.468823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-557f8773-f3f3-4f14-9197-0fda003c0745 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:04.480512 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f8773-f3f3-4f14-9197-0fda003c0745 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:04.488197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e8d58-621e-40f2-8702-371836c718f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:04.488856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e8d58-621e-40f2-8702-371836c718f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:04.489142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e8d58-621e-40f2-8702-371836c718f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:04.489422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e8d58-621e-40f2-8702-371836c718f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:04.547126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e8d58-621e-40f2-8702-371836c718f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:04.548518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e8d58-621e-40f2-8702-371836c718f6 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:04.557583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1217/2470] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:05.076140 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576c9e5-b954-4118-9c99-8338ce399e49 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:05.085308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576c9e5-b954-4118-9c99-8338ce399e49 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:05.088860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df14e75-16de-4162-b10b-ee69c2fbd7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:05.089487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df14e75-16de-4162-b10b-ee69c2fbd7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:05.089766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df14e75-16de-4162-b10b-ee69c2fbd7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:05.090036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df14e75-16de-4162-b10b-ee69c2fbd7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:05.099736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df14e75-16de-4162-b10b-ee69c2fbd7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:05.101143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df14e75-16de-4162-b10b-ee69c2fbd7f4 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:05.111514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1254/2471] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:06.675070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e8d58-621e-40f2-8702-371836c718f6 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:06.698625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e8d58-621e-40f2-8702-371836c718f6 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:06.704770 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:06.705605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:06.706518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:06.706805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:06.708682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:06.755703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df14e75-16de-4162-b10b-ee69c2fbd7f4 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:06.765638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df14e75-16de-4162-b10b-ee69c2fbd7f4 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:06.770435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2d477-fe68-47b7-bb6b-5a4634771d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:06.771221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2d477-fe68-47b7-bb6b-5a4634771d75 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:06.771550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2d477-fe68-47b7-bb6b-5a4634771d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:06.771825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2d477-fe68-47b7-bb6b-5a4634771d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:06.773676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-71b2d477-fe68-47b7-bb6b-5a4634771d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:06.779152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:06.794426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:06.797026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:06.808344 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1218/2472] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:06.847923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2d477-fe68-47b7-bb6b-5a4634771d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:06.849356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2d477-fe68-47b7-bb6b-5a4634771d75 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:06.864128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1255/2473] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:27:07.491670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:07.492992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:07.505386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1f752-5001-41c9-8d89-1faf49b8a15f service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:07.509068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b59ac-2419-469d-9348-7c1fd312b1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:07.509709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b59ac-2419-469d-9348-7c1fd312b1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:07.509993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b59ac-2419-469d-9348-7c1fd312b1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:07.510287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b59ac-2419-469d-9348-7c1fd312b1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:07.512031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-be9b59ac-2419-469d-9348-7c1fd312b1f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:07.521957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b59ac-2419-469d-9348-7c1fd312b1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:07.523415 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b59ac-2419-469d-9348-7c1fd312b1f6 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:07.531588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1219/2474] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:07.639146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be630c13-60b7-43d2-a883-aade030d183c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:07.639361 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be630c13-60b7-43d2-a883-aade030d183c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:07.639666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be630c13-60b7-43d2-a883-aade030d183c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:07.641899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1256/2475] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:27:07.648394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642de0d-7c01-44fc-a3af-59a980ed9224 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:07.648746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642de0d-7c01-44fc-a3af-59a980ed9224 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:07.649046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642de0d-7c01-44fc-a3af-59a980ed9224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:07.669680 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8642de0d-7c01-44fc-a3af-59a980ed9224 None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:07.671585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8642de0d-7c01-44fc-a3af-59a980ed9224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:07.750748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1220/2476] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:07.763854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be630c13-60b7-43d2-a883-aade030d183c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:07.765821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-be630c13-60b7-43d2-a883-aade030d183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:07.830341 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be630c13-60b7-43d2-a883-aade030d183c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:07.833912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73ec6e-7cad-444e-addc-c337a1b5ae6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a418c5817e784d299c8d6daad20c6cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:07.834557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73ec6e-7cad-444e-addc-c337a1b5ae6f service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:07.834836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73ec6e-7cad-444e-addc-c337a1b5ae6f service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:07.835108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73ec6e-7cad-444e-addc-c337a1b5ae6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:07.845455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73ec6e-7cad-444e-addc-c337a1b5ae6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:07.846867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73ec6e-7cad-444e-addc-c337a1b5ae6f service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:07.857994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1257/2477] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:07.935425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad4c9a-4c5a-41d6-b4da-29bc65a35f2b None None] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:07.935721 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad4c9a-4c5a-41d6-b4da-29bc65a35f2b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:07.936284 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad4c9a-4c5a-41d6-b4da-29bc65a35f2b None None] PATH_INFO: `/` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:07.938910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1221/2478] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:27:07.944436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb5cb6-513a-4548-82ca-91c71a3f83e2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:07.944965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb5cb6-513a-4548-82ca-91c71a3f83e2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:07.945458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb5cb6-513a-4548-82ca-91c71a3f83e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:07.967126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-73bb5cb6-513a-4548-82ca-91c71a3f83e2 None None] MFA Rules not processed for user `fafd295a115c4f5d912e49d6a21d67b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:07.968735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-73bb5cb6-513a-4548-82ca-91c71a3f83e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:07.975783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1258/2479] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:07.988243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad4c9a-4c5a-41d6-b4da-29bc65a35f2b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:08.000425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad4c9a-4c5a-41d6-b4da-29bc65a35f2b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:08.004253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca24303-6740-4f07-8606-756ad48c788a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:08.004901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca24303-6740-4f07-8606-756ad48c788a service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:08.005192 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca24303-6740-4f07-8606-756ad48c788a service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:08.005476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca24303-6740-4f07-8606-756ad48c788a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:08.013341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca24303-6740-4f07-8606-756ad48c788a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:08.014864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca24303-6740-4f07-8606-756ad48c788a service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:08.023520 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1222/2480] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:08.110317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e60cd8-ce9f-4859-9dd8-7d642ec7d202 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:08.110449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e60cd8-ce9f-4859-9dd8-7d642ec7d202 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:08.111025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e60cd8-ce9f-4859-9dd8-7d642ec7d202 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:08.112429 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1259/2481] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jun 7 14:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 07 14:27:08.117782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af439b5-92e7-4965-ad2c-c872aa95fdda None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:08.118074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af439b5-92e7-4965-ad2c-c872aa95fdda None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:08.118356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af439b5-92e7-4965-ad2c-c872aa95fdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:08.147178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7af439b5-92e7-4965-ad2c-c872aa95fdda None None] MFA Rules not processed for user `e1ea02cd5e644aaba236acf4e46cb20f`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:08.148414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7af439b5-92e7-4965-ad2c-c872aa95fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:08.158828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1223/2482] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jun 7 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:08.169691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e60cd8-ce9f-4859-9dd8-7d642ec7d202 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:08.187509 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e60cd8-ce9f-4859-9dd8-7d642ec7d202 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:08.191688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9ce42-eea7-4adf-a641-584b65ba3302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:08.192389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9ce42-eea7-4adf-a641-584b65ba3302 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:08.192654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9ce42-eea7-4adf-a641-584b65ba3302 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:08.192936 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9ce42-eea7-4adf-a641-584b65ba3302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:08.203618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9ce42-eea7-4adf-a641-584b65ba3302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:08.205037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9ce42-eea7-4adf-a641-584b65ba3302 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:08.217252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1260/2483] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:08.278359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af439b5-92e7-4965-ad2c-c872aa95fdda None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:08.279791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7af439b5-92e7-4965-ad2c-c872aa95fdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:08.355036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af439b5-92e7-4965-ad2c-c872aa95fdda None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:08.361063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2c399-69bb-4e46-bd96-439443bfbf48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:08.361802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2c399-69bb-4e46-bd96-439443bfbf48 service placement] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:08.362090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2c399-69bb-4e46-bd96-439443bfbf48 service placement] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:08.362373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2c399-69bb-4e46-bd96-439443bfbf48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:08.364547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a9e2c399-69bb-4e46-bd96-439443bfbf48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:08.377373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2c399-69bb-4e46-bd96-439443bfbf48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:08.378949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2c399-69bb-4e46-bd96-439443bfbf48 service placement] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:08.389116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1224/2484] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:09.034438 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9ce42-eea7-4adf-a641-584b65ba3302 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:09.052896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:09.098227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9ce42-eea7-4adf-a641-584b65ba3302 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:09.104112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:09.105289 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:09.105574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:09.105846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] PATH_INFO: `/v3/users/2e518da9d22342a0bee9fb583b43ef7f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:09.107036 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e518da9d22342a0bee9fb583b43ef7f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:09.109020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:09.160336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e518da9d22342a0bee9fb583b43ef7f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.167270 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e518da9d22342a0bee9fb583b43ef7f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.167951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e518da9d22342a0bee9fb583b43ef7f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.175284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e518da9d22342a0bee9fb583b43ef7f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.187597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e518da9d22342a0bee9fb583b43ef7f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.193691 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1261/2485] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:09 2022] DELETE /identity/v3/users/2e518da9d22342a0bee9fb583b43ef7f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:09.198154 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e2de-f021-4d1a-8b71-0f2d98a5c201 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:09.198620 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e2de-f021-4d1a-8b71-0f2d98a5c201 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:09.198741 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019e2de-f021-4d1a-8b71-0f2d98a5c201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:09.216062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7019e2de-f021-4d1a-8b71-0f2d98a5c201 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:09.217290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7019e2de-f021-4d1a-8b71-0f2d98a5c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:09.250683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:09.275638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1225/2486] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:09.285256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:09.286685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:09.343745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d91f3-9758-4d00-9468-f551ea1a2631 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:09.348454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0fa7a-ac45-416a-ada5-b5bd6d6b1635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:09.349141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0fa7a-ac45-416a-ada5-b5bd6d6b1635 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:09.349490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0fa7a-ac45-416a-ada5-b5bd6d6b1635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:09.349807 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0fa7a-ac45-416a-ada5-b5bd6d6b1635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:09.359681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0fa7a-ac45-416a-ada5-b5bd6d6b1635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:09.361088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0fa7a-ac45-416a-ada5-b5bd6d6b1635 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:09.370417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1262/2487] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:09.712947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019e2de-f021-4d1a-8b71-0f2d98a5c201 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:09.714617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7019e2de-f021-4d1a-8b71-0f2d98a5c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:09.733543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019e2de-f021-4d1a-8b71-0f2d98a5c201 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:09.739086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:09.740323 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:09.740619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:09.740791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] PATH_INFO: `/v3/projects/b52ad4eab09042658bf03332c5dff12f` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:09.741974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52ad4eab09042658bf03332c5dff12f)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:09.743983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:09.791614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52ad4eab09042658bf03332c5dff12f', 'request_id': 'req-542b5736-263b-489c-8296-e37c79716137'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.797696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52ad4eab09042658bf03332c5dff12f', 'request_id': 'req-542b5736-263b-489c-8296-e37c79716137'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.804915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52ad4eab09042658bf03332c5dff12f', 'request_id': 'req-542b5736-263b-489c-8296-e37c79716137'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.815979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] The token cache is being invalidate because project b52ad4eab09042658bf03332c5dff12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:09.816265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.816885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.818423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1226/2488] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:09 2022] DELETE /identity/v3/projects/b52ad4eab09042658bf03332c5dff12f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:09.822667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0fa7a-ac45-416a-ada5-b5bd6d6b1635 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:09.833902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0fa7a-ac45-416a-ada5-b5bd6d6b1635 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:09.870779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:09.892783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:09.893808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:09.894097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:09.894374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] PATH_INFO: `/v3/users/b658c247884947e5872a6eafb61b793b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:09.895610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b658c247884947e5872a6eafb61b793b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:09.897575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:09.943378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b658c247884947e5872a6eafb61b793b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.953248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b658c247884947e5872a6eafb61b793b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.953938 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b658c247884947e5872a6eafb61b793b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.961095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b658c247884947e5872a6eafb61b793b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.974274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b658c247884947e5872a6eafb61b793b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:09.980579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1263/2489] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:09 2022] DELETE /identity/v3/users/b658c247884947e5872a6eafb61b793b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:10.391288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:10.392763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:10.406191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b5736-263b-489c-8296-e37c79716137 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:10.472563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:10.473568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:10.473913 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:10.474190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] PATH_INFO: `/v3/projects/cb36b2af7f844ab0b6c2ea27f0311b3b` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:10.475457 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb36b2af7f844ab0b6c2ea27f0311b3b)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:10.477366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:10.524914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb36b2af7f844ab0b6c2ea27f0311b3b', 'request_id': 'req-824318e1-5016-4275-91ac-f14cec6a6709'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.531621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb36b2af7f844ab0b6c2ea27f0311b3b', 'request_id': 'req-824318e1-5016-4275-91ac-f14cec6a6709'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.540676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb36b2af7f844ab0b6c2ea27f0311b3b', 'request_id': 'req-824318e1-5016-4275-91ac-f14cec6a6709'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.545133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:10.553651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] The token cache is being invalidate because project cb36b2af7f844ab0b6c2ea27f0311b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:10.554286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.555021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.556725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1227/2490] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:10 2022] DELETE /identity/v3/projects/cb36b2af7f844ab0b6c2ea27f0311b3b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:10.560693 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:10.562250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:10.575269 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd86cc-f0bc-4c84-9a28-ea1417ff6d72 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:10.637131 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:10.638012 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:10.638291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:10.638610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] PATH_INFO: `/v3/users/4d1e94fb12ec4d78abcd4d66f69175f1` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:10.639865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1e94fb12ec4d78abcd4d66f69175f1)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:10.641962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:10.694658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1e94fb12ec4d78abcd4d66f69175f1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.704617 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1e94fb12ec4d78abcd4d66f69175f1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.705933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1e94fb12ec4d78abcd4d66f69175f1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.710056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:10.715383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1e94fb12ec4d78abcd4d66f69175f1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.734306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1e94fb12ec4d78abcd4d66f69175f1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:10.740884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1264/2491] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:10 2022] DELETE /identity/v3/users/4d1e94fb12ec4d78abcd4d66f69175f1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:11.203249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:11.205502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:11.319734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824318e1-5016-4275-91ac-f14cec6a6709 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:11.333892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:11.335448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:11.418750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8d846-0420-4e48-9dfb-1ec91f3ed317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:11.419544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8d846-0420-4e48-9dfb-1ec91f3ed317 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:11.419899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8d846-0420-4e48-9dfb-1ec91f3ed317 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:11.420337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8d846-0420-4e48-9dfb-1ec91f3ed317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:11.424340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-70c8d846-0420-4e48-9dfb-1ec91f3ed317 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:11.512442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d01a1-bf39-4838-ad15-ac991836b868 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:11.517652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8d846-0420-4e48-9dfb-1ec91f3ed317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:11.518498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:11.519591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8d846-0420-4e48-9dfb-1ec91f3ed317 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:11.519950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:11.520231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:11.520741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] PATH_INFO: `/v3/projects/3ef055098a214b4c85d268cf5339a88a` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:11.522277 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef055098a214b4c85d268cf5339a88a)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:11.524580 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:11.533548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1228/2492] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:11.600068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef055098a214b4c85d268cf5339a88a', 'request_id': 'req-63b447ea-9429-4c89-900e-9779fb0212e1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:11.612731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef055098a214b4c85d268cf5339a88a', 'request_id': 'req-63b447ea-9429-4c89-900e-9779fb0212e1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:11.623649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef055098a214b4c85d268cf5339a88a', 'request_id': 'req-63b447ea-9429-4c89-900e-9779fb0212e1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:11.641844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] The token cache is being invalidate because project 3ef055098a214b4c85d268cf5339a88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:11.642188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:11.642895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-63b447ea-9429-4c89-900e-9779fb0212e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:11.649020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1265/2493] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:11 2022] DELETE /identity/v3/projects/3ef055098a214b4c85d268cf5339a88a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:11.650078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509bf4a-0eb4-4874-8985-f5ebe1392b79 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:11.650328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509bf4a-0eb4-4874-8985-f5ebe1392b79 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:11.650700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509bf4a-0eb4-4874-8985-f5ebe1392b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:11.669647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-7509bf4a-0eb4-4874-8985-f5ebe1392b79 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:11.671472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-7509bf4a-0eb4-4874-8985-f5ebe1392b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:11.703981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:11.751605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1229/2494] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:11.758504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d48fe-b532-41a1-b2f4-b28cf29122cb None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:11.758839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d48fe-b532-41a1-b2f4-b28cf29122cb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:11.759063 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d48fe-b532-41a1-b2f4-b28cf29122cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:11.798462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7e1d48fe-b532-41a1-b2f4-b28cf29122cb None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:11.800061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7e1d48fe-b532-41a1-b2f4-b28cf29122cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:11.815985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509bf4a-0eb4-4874-8985-f5ebe1392b79 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:11.823939 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1266/2495] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:11.826442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509bf4a-0eb4-4874-8985-f5ebe1392b79 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:11.831487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f92a0-a92a-44ae-9a58-73cefa7fb451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:11.832162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f92a0-a92a-44ae-9a58-73cefa7fb451 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:11.832444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f92a0-a92a-44ae-9a58-73cefa7fb451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:11.832720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f92a0-a92a-44ae-9a58-73cefa7fb451 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:11.834066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f92a0-a92a-44ae-9a58-73cefa7fb451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:27:11.834379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f92a0-a92a-44ae-9a58-73cefa7fb451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:11.837843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f92a0-a92a-44ae-9a58-73cefa7fb451 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:11.858822 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d48fe-b532-41a1-b2f4-b28cf29122cb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:11.865893 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1230/2496] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:27:11.871257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d48fe-b532-41a1-b2f4-b28cf29122cb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:11.878314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f3743-5447-4617-8260-9e2c1996eea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:11.878944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3743-5447-4617-8260-9e2c1996eea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:11.879295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3743-5447-4617-8260-9e2c1996eea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:11.879806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3743-5447-4617-8260-9e2c1996eea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:11.880603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f3743-5447-4617-8260-9e2c1996eea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:11.882592 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f3743-5447-4617-8260-9e2c1996eea8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:11.913955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1267/2497] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:11 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:27:11.915531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f92a0-a92a-44ae-9a58-73cefa7fb451 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:11.927526 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f92a0-a92a-44ae-9a58-73cefa7fb451 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:12.038636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad94d27-30b5-4bc2-9593-048c0f89de91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:12.039698 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad94d27-30b5-4bc2-9593-048c0f89de91 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:12.040028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad94d27-30b5-4bc2-9593-048c0f89de91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:12.040384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad94d27-30b5-4bc2-9593-048c0f89de91 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:12.041245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad94d27-30b5-4bc2-9593-048c0f89de91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:12.043513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad94d27-30b5-4bc2-9593-048c0f89de91 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:12.062493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb56a2-3e36-4d2c-a9e4-b0b4f7247ed1 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:12.063095 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb56a2-3e36-4d2c-a9e4-b0b4f7247ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:12.063915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb56a2-3e36-4d2c-a9e4-b0b4f7247ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:12.075414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1231/2498] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:11 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:12.080030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad94d27-30b5-4bc2-9593-048c0f89de91 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:12.096548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-eafb56a2-3e36-4d2c-a9e4-b0b4f7247ed1 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:12.097928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-eafb56a2-3e36-4d2c-a9e4-b0b4f7247ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:12.110622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad94d27-30b5-4bc2-9593-048c0f89de91 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:12.116205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4b12-708d-4d38-9f9f-aded5f03a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:12.116881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4b12-708d-4d38-9f9f-aded5f03a2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:12.117180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4b12-708d-4d38-9f9f-aded5f03a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:12.117511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e4b12-708d-4d38-9f9f-aded5f03a2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:12.118257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e4b12-708d-4d38-9f9f-aded5f03a2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:12.119968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e4b12-708d-4d38-9f9f-aded5f03a2fc admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:12.136587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1232/2499] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:12.140774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4b12-708d-4d38-9f9f-aded5f03a2fc admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:12.151326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:12.151708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e4b12-708d-4d38-9f9f-aded5f03a2fc admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:12.162441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855ec65-af4e-4ebe-89f6-0c6c23de9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:12.163374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855ec65-af4e-4ebe-89f6-0c6c23de9219 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:12.163762 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855ec65-af4e-4ebe-89f6-0c6c23de9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:12.164120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855ec65-af4e-4ebe-89f6-0c6c23de9219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:12.164778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855ec65-af4e-4ebe-89f6-0c6c23de9219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:12.166403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855ec65-af4e-4ebe-89f6-0c6c23de9219 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:12.178503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1233/2500] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:27:12.182657 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855ec65-af4e-4ebe-89f6-0c6c23de9219 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:12.185411 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1268/2501] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:27:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:12.196353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855ec65-af4e-4ebe-89f6-0c6c23de9219 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:12.199946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb56a2-3e36-4d2c-a9e4-b0b4f7247ed1 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:12.201699 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b067bf-618f-49ad-a01c-4320037f4664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:12.202443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-eafb56a2-3e36-4d2c-a9e4-b0b4f7247ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:12.203278 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b067bf-618f-49ad-a01c-4320037f4664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:12.203714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b067bf-618f-49ad-a01c-4320037f4664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:12.203999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b067bf-618f-49ad-a01c-4320037f4664 admin admin] PATH_INFO: `/v3/projects/5b55a4ea6e3b44e4976319a24ee487da/users/266f41e3846a49409889ed7b1f0147e4/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:12.221709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b067bf-618f-49ad-a01c-4320037f4664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b55a4ea6e3b44e4976319a24ee487da, user_id=266f41e3846a49409889ed7b1f0147e4, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:12.224417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b067bf-618f-49ad-a01c-4320037f4664 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:12.239385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1234/2502] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:12 2022] PUT /identity/v3/projects/5b55a4ea6e3b44e4976319a24ee487da/users/266f41e3846a49409889ed7b1f0147e4/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:12.249632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d7acf-872d-4c6d-a783-17989655b1c6 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:12.250194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d7acf-872d-4c6d-a783-17989655b1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:12.250642 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d7acf-872d-4c6d-a783-17989655b1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:12.279264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-891d7acf-872d-4c6d-a783-17989655b1c6 None None] MFA Rules not processed for user `266f41e3846a49409889ed7b1f0147e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:12.281081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-891d7acf-872d-4c6d-a783-17989655b1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:12.290724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb56a2-3e36-4d2c-a9e4-b0b4f7247ed1 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:12.335816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:12.356522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabfb7d-3f89-458e-9877-624bcca9cc35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:12.357181 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabfb7d-3f89-458e-9877-624bcca9cc35 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:12.357521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabfb7d-3f89-458e-9877-624bcca9cc35 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:12.357797 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabfb7d-3f89-458e-9877-624bcca9cc35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:12.359009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1235/2503] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:12.369541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d7acf-872d-4c6d-a783-17989655b1c6 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:12.370891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-891d7acf-872d-4c6d-a783-17989655b1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:12.422618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabfb7d-3f89-458e-9877-624bcca9cc35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:12.424372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabfb7d-3f89-458e-9877-624bcca9cc35 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:12.433233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1269/2504] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:27:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 14:27:12.437640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d7acf-872d-4c6d-a783-17989655b1c6 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:12.441920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bf1fc-aa7b-45f4-8e8f-e90ac43279d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:12.442588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bf1fc-aa7b-45f4-8e8f-e90ac43279d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:12.442874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bf1fc-aa7b-45f4-8e8f-e90ac43279d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:12.443151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bf1fc-aa7b-45f4-8e8f-e90ac43279d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:12.453146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bf1fc-aa7b-45f4-8e8f-e90ac43279d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:12.454813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bf1fc-aa7b-45f4-8e8f-e90ac43279d3 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:12.465707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1236/2505] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:27:17.570566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabfb7d-3f89-458e-9877-624bcca9cc35 service swift] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:17.572370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4cabfb7d-3f89-458e-9877-624bcca9cc35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:17.605774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:17.632952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabfb7d-3f89-458e-9877-624bcca9cc35 service swift] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:17.639261 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dc4d2-2076-4e02-b5c9-18945f137449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:17.639962 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dc4d2-2076-4e02-b5c9-18945f137449 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:17.640246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dc4d2-2076-4e02-b5c9-18945f137449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:17.640523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04dc4d2-2076-4e02-b5c9-18945f137449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:17.642362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f04dc4d2-2076-4e02-b5c9-18945f137449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:17.708982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dc4d2-2076-4e02-b5c9-18945f137449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:17.710590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04dc4d2-2076-4e02-b5c9-18945f137449 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:17.721377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1270/2506] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:21.581546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bf1fc-aa7b-45f4-8e8f-e90ac43279d3 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:21.582969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8c4bf1fc-aa7b-45f4-8e8f-e90ac43279d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:21.597492 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bf1fc-aa7b-45f4-8e8f-e90ac43279d3 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:21.601972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:21.602828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:21.603099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:21.603393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] PATH_INFO: `/v3/users/d619c0247a084d07941bd70c14b66b39` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:21.604565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d619c0247a084d07941bd70c14b66b39)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:21.606468 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:21.653223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd619c0247a084d07941bd70c14b66b39'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:21.653973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd619c0247a084d07941bd70c14b66b39'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:21.660977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd619c0247a084d07941bd70c14b66b39'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:21.661599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd619c0247a084d07941bd70c14b66b39'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:21.669115 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-77fd282e-f3ad-45b0-8fa3-e4894171d559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd619c0247a084d07941bd70c14b66b39'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:21.686970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1237/2507] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:21 2022] DELETE /identity/v3/users/d619c0247a084d07941bd70c14b66b39 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:21.869167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dc4d2-2076-4e02-b5c9-18945f137449 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:21.879596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04dc4d2-2076-4e02-b5c9-18945f137449 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:21.941285 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:21.942075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:21.942365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:21.942647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] PATH_INFO: `/v3/projects/54ea2b32b88f4eaeb738e72903024234` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:21.943870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ea2b32b88f4eaeb738e72903024234)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:21.945798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:21.991360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ea2b32b88f4eaeb738e72903024234', 'request_id': 'req-c63077c5-af78-4847-bd78-de7fe791e8b1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:22.000591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ea2b32b88f4eaeb738e72903024234', 'request_id': 'req-c63077c5-af78-4847-bd78-de7fe791e8b1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:22.006276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ea2b32b88f4eaeb738e72903024234', 'request_id': 'req-c63077c5-af78-4847-bd78-de7fe791e8b1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:22.019358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] The token cache is being invalidate because project 54ea2b32b88f4eaeb738e72903024234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:22.019666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:22.020366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c63077c5-af78-4847-bd78-de7fe791e8b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:22.022112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1271/2508] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:21 2022] DELETE /identity/v3/projects/54ea2b32b88f4eaeb738e72903024234 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:22.026887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0281-7f3e-4c33-8e65-0c72e86553a2 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.027234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0281-7f3e-4c33-8e65-0c72e86553a2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.027537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f0281-7f3e-4c33-8e65-0c72e86553a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.045426 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-516f0281-7f3e-4c33-8e65-0c72e86553a2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:22.046632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-516f0281-7f3e-4c33-8e65-0c72e86553a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:22.113510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1238/2509] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:22.121475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534e26d-c632-4054-baf2-97a31d9f3120 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.121851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534e26d-c632-4054-baf2-97a31d9f3120 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.122455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534e26d-c632-4054-baf2-97a31d9f3120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.142360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4534e26d-c632-4054-baf2-97a31d9f3120 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:22.143586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4534e26d-c632-4054-baf2-97a31d9f3120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:22.152037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1272/2510] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:22.156151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f0281-7f3e-4c33-8e65-0c72e86553a2 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.162190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:22.166159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f0281-7f3e-4c33-8e65-0c72e86553a2 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.172806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25c76c-575a-4094-86e8-7577d0a96632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.173626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25c76c-575a-4094-86e8-7577d0a96632 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.174112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25c76c-575a-4094-86e8-7577d0a96632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.174456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25c76c-575a-4094-86e8-7577d0a96632 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.175425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25c76c-575a-4094-86e8-7577d0a96632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:27:22.175736 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25c76c-575a-4094-86e8-7577d0a96632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.177374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25c76c-575a-4094-86e8-7577d0a96632 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.189826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1239/2511] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:27:22.194554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534e26d-c632-4054-baf2-97a31d9f3120 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.199060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:22.205996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534e26d-c632-4054-baf2-97a31d9f3120 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.211671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1f6f-17cd-43d8-a60e-73bb156cf6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.212359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1f6f-17cd-43d8-a60e-73bb156cf6fc admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.212626 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1f6f-17cd-43d8-a60e-73bb156cf6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.212913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1f6f-17cd-43d8-a60e-73bb156cf6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.213605 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c1f6f-17cd-43d8-a60e-73bb156cf6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.215523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c1f6f-17cd-43d8-a60e-73bb156cf6fc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.241388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1273/2512] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:22 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:22.245757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25c76c-575a-4094-86e8-7577d0a96632 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.256174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25c76c-575a-4094-86e8-7577d0a96632 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.314351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab57e-4a8a-4c26-b239-2a3d90bc2593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.315034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab57e-4a8a-4c26-b239-2a3d90bc2593 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.315318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab57e-4a8a-4c26-b239-2a3d90bc2593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.315621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab57e-4a8a-4c26-b239-2a3d90bc2593 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.316313 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cab57e-4a8a-4c26-b239-2a3d90bc2593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.318218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cab57e-4a8a-4c26-b239-2a3d90bc2593 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.338008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1240/2513] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:22 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:22.341520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1f6f-17cd-43d8-a60e-73bb156cf6fc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.352243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1f6f-17cd-43d8-a60e-73bb156cf6fc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.356930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e880b-7c36-4bad-9c4b-025416ac3941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.358278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e880b-7c36-4bad-9c4b-025416ac3941 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.358568 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e880b-7c36-4bad-9c4b-025416ac3941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.358850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e880b-7c36-4bad-9c4b-025416ac3941 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.359610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e880b-7c36-4bad-9c4b-025416ac3941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.361201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e880b-7c36-4bad-9c4b-025416ac3941 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.371420 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1274/2514] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:22.375428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab57e-4a8a-4c26-b239-2a3d90bc2593 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.385239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab57e-4a8a-4c26-b239-2a3d90bc2593 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.389783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c217b1-6352-4eab-9157-d16c1f5ff661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.390424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c217b1-6352-4eab-9157-d16c1f5ff661 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.390703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c217b1-6352-4eab-9157-d16c1f5ff661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.390977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c217b1-6352-4eab-9157-d16c1f5ff661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.391754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c217b1-6352-4eab-9157-d16c1f5ff661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.393580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c217b1-6352-4eab-9157-d16c1f5ff661 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.403286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1241/2515] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:22.407802 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e880b-7c36-4bad-9c4b-025416ac3941 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.417569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e880b-7c36-4bad-9c4b-025416ac3941 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.422770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca8b59-c167-4758-96c9-0fb25573820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.423677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca8b59-c167-4758-96c9-0fb25573820c admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.423961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca8b59-c167-4758-96c9-0fb25573820c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.424235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca8b59-c167-4758-96c9-0fb25573820c admin admin] PATH_INFO: `/v3/projects/dfd1e42d4e3e4a10a6e56e91b2bca56b/users/5c404bd8c0d34ce993425fc52801fae4/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.438674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca8b59-c167-4758-96c9-0fb25573820c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd1e42d4e3e4a10a6e56e91b2bca56b, user_id=5c404bd8c0d34ce993425fc52801fae4, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.441321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca8b59-c167-4758-96c9-0fb25573820c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.453644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1275/2516] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:22 2022] PUT /identity/v3/projects/dfd1e42d4e3e4a10a6e56e91b2bca56b/users/5c404bd8c0d34ce993425fc52801fae4/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:22.464175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e0d49-d143-4f22-ba25-d0966bcdf743 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.464469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e0d49-d143-4f22-ba25-d0966bcdf743 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.464746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e0d49-d143-4f22-ba25-d0966bcdf743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.492107 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-316e0d49-d143-4f22-ba25-d0966bcdf743 None None] MFA Rules not processed for user `5c404bd8c0d34ce993425fc52801fae4`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:22.493524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-316e0d49-d143-4f22-ba25-d0966bcdf743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:22.557320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1242/2517] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:22.561671 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca8b59-c167-4758-96c9-0fb25573820c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.622362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca8b59-c167-4758-96c9-0fb25573820c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.627221 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33021a-49d3-4e48-b3bd-9d186cec3069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.627926 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33021a-49d3-4e48-b3bd-9d186cec3069 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.628214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33021a-49d3-4e48-b3bd-9d186cec3069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.628493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33021a-49d3-4e48-b3bd-9d186cec3069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.629190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33021a-49d3-4e48-b3bd-9d186cec3069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.631091 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33021a-49d3-4e48-b3bd-9d186cec3069 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.656084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1276/2518] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:22 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:22.660134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e0d49-d143-4f22-ba25-d0966bcdf743 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.671354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e0d49-d143-4f22-ba25-d0966bcdf743 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.726706 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07de21-c49d-4fde-ba79-0826397f96cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.727298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07de21-c49d-4fde-ba79-0826397f96cf admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.727607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07de21-c49d-4fde-ba79-0826397f96cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.727881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07de21-c49d-4fde-ba79-0826397f96cf admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.728569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07de21-c49d-4fde-ba79-0826397f96cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.730469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07de21-c49d-4fde-ba79-0826397f96cf admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.736979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:22.751504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1243/2519] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:22 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:22.755408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33021a-49d3-4e48-b3bd-9d186cec3069 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.766146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33021a-49d3-4e48-b3bd-9d186cec3069 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.770907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f4602-8148-4298-9933-8ec34e47ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.771620 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f4602-8148-4298-9933-8ec34e47ba8b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.771909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f4602-8148-4298-9933-8ec34e47ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.772188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f4602-8148-4298-9933-8ec34e47ba8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.772916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f4602-8148-4298-9933-8ec34e47ba8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.774517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f4602-8148-4298-9933-8ec34e47ba8b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.786202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1277/2520] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:22.790382 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07de21-c49d-4fde-ba79-0826397f96cf admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.800326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07de21-c49d-4fde-ba79-0826397f96cf admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.804928 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9273b-862d-4f6f-8df5-69c9561f92b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.805795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9273b-862d-4f6f-8df5-69c9561f92b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.806082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9273b-862d-4f6f-8df5-69c9561f92b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.806362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9273b-862d-4f6f-8df5-69c9561f92b4 admin admin] PATH_INFO: `/v3/projects/d7a36cd1fb45446d970db6d13e9beb4e/users/12b9223ccaa04782bd6d8be64e9257dc/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.820938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9273b-862d-4f6f-8df5-69c9561f92b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a36cd1fb45446d970db6d13e9beb4e, user_id=12b9223ccaa04782bd6d8be64e9257dc, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.823615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9273b-862d-4f6f-8df5-69c9561f92b4 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.836257 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1244/2521] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:22 2022] PUT /identity/v3/projects/d7a36cd1fb45446d970db6d13e9beb4e/users/12b9223ccaa04782bd6d8be64e9257dc/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:22.840193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f4602-8148-4298-9933-8ec34e47ba8b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.850774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f4602-8148-4298-9933-8ec34e47ba8b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.908077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04ada0-36cd-40a4-8a6a-9ec0fbd08d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.908772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04ada0-36cd-40a4-8a6a-9ec0fbd08d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.909022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04ada0-36cd-40a4-8a6a-9ec0fbd08d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.909295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04ada0-36cd-40a4-8a6a-9ec0fbd08d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.910054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04ada0-36cd-40a4-8a6a-9ec0fbd08d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.911694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04ada0-36cd-40a4-8a6a-9ec0fbd08d33 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.922130 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1278/2522] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:22.926417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9273b-862d-4f6f-8df5-69c9561f92b4 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:22.937186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9273b-862d-4f6f-8df5-69c9561f92b4 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:22.942286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32a000-6ca0-43d7-8b83-6fb7dfbf1814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:22.943279 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32a000-6ca0-43d7-8b83-6fb7dfbf1814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.943660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32a000-6ca0-43d7-8b83-6fb7dfbf1814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.944031 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32a000-6ca0-43d7-8b83-6fb7dfbf1814 admin admin] PATH_INFO: `/v3/projects/d7a36cd1fb45446d970db6d13e9beb4e/users/12b9223ccaa04782bd6d8be64e9257dc/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.946321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32a000-6ca0-43d7-8b83-6fb7dfbf1814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a36cd1fb45446d970db6d13e9beb4e, user_id=12b9223ccaa04782bd6d8be64e9257dc, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:22.948877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32a000-6ca0-43d7-8b83-6fb7dfbf1814 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:22.960673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1245/2523] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:22 2022] PUT /identity/v3/projects/d7a36cd1fb45446d970db6d13e9beb4e/users/12b9223ccaa04782bd6d8be64e9257dc/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:22.971493 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0343e53-7324-47b1-a3ee-e0f206c5b9d4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:22.971793 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0343e53-7324-47b1-a3ee-e0f206c5b9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:22.972075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0343e53-7324-47b1-a3ee-e0f206c5b9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:22.999093 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c0343e53-7324-47b1-a3ee-e0f206c5b9d4 None None] MFA Rules not processed for user `12b9223ccaa04782bd6d8be64e9257dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:23.000442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c0343e53-7324-47b1-a3ee-e0f206c5b9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:23.004696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:23.071092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1279/2524] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:23.082620 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32a000-6ca0-43d7-8b83-6fb7dfbf1814 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:23.084330 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ff32a000-6ca0-43d7-8b83-6fb7dfbf1814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:23.142932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32a000-6ca0-43d7-8b83-6fb7dfbf1814 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:23.147021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9bd6b-35cf-4c43-b2b8-db1431069f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:23.147655 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0343e53-7324-47b1-a3ee-e0f206c5b9d4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:23.147791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9bd6b-35cf-4c43-b2b8-db1431069f6a service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:23.148012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9bd6b-35cf-4c43-b2b8-db1431069f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:23.148292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9bd6b-35cf-4c43-b2b8-db1431069f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:23.149058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c0343e53-7324-47b1-a3ee-e0f206c5b9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:23.157915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9bd6b-35cf-4c43-b2b8-db1431069f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:23.159357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9bd6b-35cf-4c43-b2b8-db1431069f6a service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:23.169054 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1246/2525] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:23.196987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9bd6b-35cf-4c43-b2b8-db1431069f6a service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:23.215291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0343e53-7324-47b1-a3ee-e0f206c5b9d4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:23.220185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:23.221085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:23.221372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:23.221654 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] PATH_INFO: `/v3/users/266f41e3846a49409889ed7b1f0147e4` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:23.222999 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266f41e3846a49409889ed7b1f0147e4)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:23.224986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:23.260009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9bd6b-35cf-4c43-b2b8-db1431069f6a service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:23.265307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:23.266182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:23.266467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:23.266738 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] PATH_INFO: `/v3/users/5c404bd8c0d34ce993425fc52801fae4` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:23.267994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c404bd8c0d34ce993425fc52801fae4)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:23.269910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:23.272213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266f41e3846a49409889ed7b1f0147e4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.279322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266f41e3846a49409889ed7b1f0147e4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.280209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266f41e3846a49409889ed7b1f0147e4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.287730 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266f41e3846a49409889ed7b1f0147e4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.300983 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3c70f08-b9c9-46c1-be5d-270e4ad2b889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266f41e3846a49409889ed7b1f0147e4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.307194 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1280/2526] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:23 2022] DELETE /identity/v3/users/266f41e3846a49409889ed7b1f0147e4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:23.312019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb655a6-3492-4443-91ff-edb60fb9e591 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:23.312374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb655a6-3492-4443-91ff-edb60fb9e591 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:23.312694 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb655a6-3492-4443-91ff-edb60fb9e591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:23.317802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c404bd8c0d34ce993425fc52801fae4'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.318480 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c404bd8c0d34ce993425fc52801fae4'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.325460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c404bd8c0d34ce993425fc52801fae4'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.326159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c404bd8c0d34ce993425fc52801fae4'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.328507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:23.329922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4cb655a6-3492-4443-91ff-edb60fb9e591 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:23.331234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4cb655a6-3492-4443-91ff-edb60fb9e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:23.337957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9c21cd5b-e6eb-4ba7-949c-6faae63990d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c404bd8c0d34ce993425fc52801fae4'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:23.347422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:23.359894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1247/2527] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:23 2022] DELETE /identity/v3/users/5c404bd8c0d34ce993425fc52801fae4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:23.364235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029f40a-a7fa-44a1-bbda-0dbb917982aa None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:23.364631 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029f40a-a7fa-44a1-bbda-0dbb917982aa None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:23.364991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029f40a-a7fa-44a1-bbda-0dbb917982aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:23.382716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-2029f40a-a7fa-44a1-bbda-0dbb917982aa None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:23.384101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2029f40a-a7fa-44a1-bbda-0dbb917982aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:23.398015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1281/2528] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:23.407770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb655a6-3492-4443-91ff-edb60fb9e591 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:23.409148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4cb655a6-3492-4443-91ff-edb60fb9e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:23.452076 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1248/2529] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:23.462754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029f40a-a7fa-44a1-bbda-0dbb917982aa None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:23.468695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb655a6-3492-4443-91ff-edb60fb9e591 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:23.522573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029f40a-a7fa-44a1-bbda-0dbb917982aa None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:23.525651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758be50-b0aa-41fb-93e9-2f074dd5967f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:23.526304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758be50-b0aa-41fb-93e9-2f074dd5967f service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:23.526417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f6103-6d73-4742-a5aa-b99289be948e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:23.526591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758be50-b0aa-41fb-93e9-2f074dd5967f service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:23.526869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758be50-b0aa-41fb-93e9-2f074dd5967f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:23.527352 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f6103-6d73-4742-a5aa-b99289be948e service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:23.527746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f6103-6d73-4742-a5aa-b99289be948e service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:23.528111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f6103-6d73-4742-a5aa-b99289be948e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:23.536153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758be50-b0aa-41fb-93e9-2f074dd5967f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:23.537437 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f6103-6d73-4742-a5aa-b99289be948e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:23.537586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758be50-b0aa-41fb-93e9-2f074dd5967f service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:23.538990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f6103-6d73-4742-a5aa-b99289be948e service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:23.548541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1282/2530] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:27:23.549291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1249/2531] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:27:23.913369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758be50-b0aa-41fb-93e9-2f074dd5967f service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:23.914830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f758be50-b0aa-41fb-93e9-2f074dd5967f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:23.931430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758be50-b0aa-41fb-93e9-2f074dd5967f service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:23.933367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f6103-6d73-4742-a5aa-b99289be948e service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:23.934807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b43f6103-6d73-4742-a5aa-b99289be948e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:23.950710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f6103-6d73-4742-a5aa-b99289be948e service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:23.954179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:23.954964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:23.955399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:23.955527 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] PATH_INFO: `/v3/projects/5b55a4ea6e3b44e4976319a24ee487da` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:23.957058 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b55a4ea6e3b44e4976319a24ee487da)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:23.958961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:23.969636 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:23.970788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:23.971080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:23.971376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] PATH_INFO: `/v3/projects/dfd1e42d4e3e4a10a6e56e91b2bca56b` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:23.972754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd1e42d4e3e4a10a6e56e91b2bca56b)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:23.974527 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:24.021698 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b55a4ea6e3b44e4976319a24ee487da', 'request_id': 'req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.036925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b55a4ea6e3b44e4976319a24ee487da', 'request_id': 'req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.037895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd1e42d4e3e4a10a6e56e91b2bca56b', 'request_id': 'req-12069958-efaa-407f-912b-63ef291abe85'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.046161 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b55a4ea6e3b44e4976319a24ee487da', 'request_id': 'req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.046828 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd1e42d4e3e4a10a6e56e91b2bca56b', 'request_id': 'req-12069958-efaa-407f-912b-63ef291abe85'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.058005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd1e42d4e3e4a10a6e56e91b2bca56b', 'request_id': 'req-12069958-efaa-407f-912b-63ef291abe85'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.061986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] The token cache is being invalidate because project 5b55a4ea6e3b44e4976319a24ee487da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:24.062284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.063345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.065273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1283/2532] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:23 2022] DELETE /identity/v3/projects/5b55a4ea6e3b44e4976319a24ee487da => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:24.073399 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] The token cache is being invalidate because project dfd1e42d4e3e4a10a6e56e91b2bca56b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:24.073757 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.074584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.079735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:24.080949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1250/2533] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:23 2022] DELETE /identity/v3/projects/dfd1e42d4e3e4a10a6e56e91b2bca56b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:24.090504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:24.090504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:24.092144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:24.183865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e2dbf-7c65-4feb-b9a9-bee5142e9783 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:24.279505 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:24.280525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:24.280885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:24.281238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] PATH_INFO: `/v3/users/12b9223ccaa04782bd6d8be64e9257dc` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:24.282644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b9223ccaa04782bd6d8be64e9257dc)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:24.284886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:24.336621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b9223ccaa04782bd6d8be64e9257dc'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.343677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b9223ccaa04782bd6d8be64e9257dc'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.344464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b9223ccaa04782bd6d8be64e9257dc'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.352514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b9223ccaa04782bd6d8be64e9257dc'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.365336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47d28eee-d852-470d-9306-bc261dca22fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b9223ccaa04782bd6d8be64e9257dc'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.371262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1284/2534] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:24 2022] DELETE /identity/v3/users/12b9223ccaa04782bd6d8be64e9257dc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:24.647849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:24.649405 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:24.663482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069958-efaa-407f-912b-63ef291abe85 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:24.725881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:24.726743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:24.727021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:24.727292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] PATH_INFO: `/v3/projects/d7a36cd1fb45446d970db6d13e9beb4e` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:24.728502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a36cd1fb45446d970db6d13e9beb4e)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:24.730364 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:24.774197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a36cd1fb45446d970db6d13e9beb4e', 'request_id': 'req-c9310693-7b8a-459b-b68a-73d4ae642ee6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.780850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a36cd1fb45446d970db6d13e9beb4e', 'request_id': 'req-c9310693-7b8a-459b-b68a-73d4ae642ee6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.787807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a36cd1fb45446d970db6d13e9beb4e', 'request_id': 'req-c9310693-7b8a-459b-b68a-73d4ae642ee6'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.798585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] The token cache is being invalidate because project d7a36cd1fb45446d970db6d13e9beb4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:24.798874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.799541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c9310693-7b8a-459b-b68a-73d4ae642ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:24.801144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1251/2535] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:24 2022] DELETE /identity/v3/projects/d7a36cd1fb45446d970db6d13e9beb4e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:24.806092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aecc5-953c-41c2-987b-9f478297ea19 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:24.806384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aecc5-953c-41c2-987b-9f478297ea19 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:24.806659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2aecc5-953c-41c2-987b-9f478297ea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:24.824122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8e2aecc5-953c-41c2-987b-9f478297ea19 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:24.825303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8e2aecc5-953c-41c2-987b-9f478297ea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:24.849461 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:24.885100 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1285/2536] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:24.894400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21894f0-4b40-4abb-a533-65947beb4cae None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:24.894690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21894f0-4b40-4abb-a533-65947beb4cae None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:24.894970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21894f0-4b40-4abb-a533-65947beb4cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:24.914104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-f21894f0-4b40-4abb-a533-65947beb4cae None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:24.915286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f21894f0-4b40-4abb-a533-65947beb4cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:24.923087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1252/2537] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:24.927145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aecc5-953c-41c2-987b-9f478297ea19 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:24.936846 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2aecc5-953c-41c2-987b-9f478297ea19 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:24.941674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2902b2d-9e0c-4f04-862d-a52560e8af3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:24.942320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902b2d-9e0c-4f04-862d-a52560e8af3f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:24.942599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902b2d-9e0c-4f04-862d-a52560e8af3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:24.942875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2902b2d-9e0c-4f04-862d-a52560e8af3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:24.943635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2902b2d-9e0c-4f04-862d-a52560e8af3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:27:24.943944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2902b2d-9e0c-4f04-862d-a52560e8af3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:24.945555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2902b2d-9e0c-4f04-862d-a52560e8af3f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:24.957443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1286/2538] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:27:24.961498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21894f0-4b40-4abb-a533-65947beb4cae None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:24.971000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21894f0-4b40-4abb-a533-65947beb4cae None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:24.975940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e56c7-58e0-42cd-8acf-cb34eb389532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:24.976583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e56c7-58e0-42cd-8acf-cb34eb389532 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:24.976860 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e56c7-58e0-42cd-8acf-cb34eb389532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:24.977131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e56c7-58e0-42cd-8acf-cb34eb389532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:24.977818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e56c7-58e0-42cd-8acf-cb34eb389532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:24.979730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e56c7-58e0-42cd-8acf-cb34eb389532 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.004027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1253/2539] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:24 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:27:25.008051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2902b2d-9e0c-4f04-862d-a52560e8af3f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.018463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2902b2d-9e0c-4f04-862d-a52560e8af3f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.073982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1b6ad-6c4b-4e60-ac82-8d5e849fd18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.074608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1b6ad-6c4b-4e60-ac82-8d5e849fd18b admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.074895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1b6ad-6c4b-4e60-ac82-8d5e849fd18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.075175 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1b6ad-6c4b-4e60-ac82-8d5e849fd18b admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.075923 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1b6ad-6c4b-4e60-ac82-8d5e849fd18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.078367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1b6ad-6c4b-4e60-ac82-8d5e849fd18b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.098420 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1287/2540] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:25 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:25.102237 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e56c7-58e0-42cd-8acf-cb34eb389532 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.113242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e56c7-58e0-42cd-8acf-cb34eb389532 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.118214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c52b56-6539-48bd-b4c3-db322d867204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.118888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c52b56-6539-48bd-b4c3-db322d867204 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.119175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c52b56-6539-48bd-b4c3-db322d867204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.119483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c52b56-6539-48bd-b4c3-db322d867204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.120516 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c52b56-6539-48bd-b4c3-db322d867204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.121855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c52b56-6539-48bd-b4c3-db322d867204 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.132617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1254/2541] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:25.136552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1b6ad-6c4b-4e60-ac82-8d5e849fd18b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.146865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1b6ad-6c4b-4e60-ac82-8d5e849fd18b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.151380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f469e1-429e-49b9-8e11-85f67f939794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.152033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f469e1-429e-49b9-8e11-85f67f939794 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.152316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f469e1-429e-49b9-8e11-85f67f939794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.152591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f469e1-429e-49b9-8e11-85f67f939794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.153308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f469e1-429e-49b9-8e11-85f67f939794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.155501 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f469e1-429e-49b9-8e11-85f67f939794 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.165120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1288/2542] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:25.169104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c52b56-6539-48bd-b4c3-db322d867204 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.179202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c52b56-6539-48bd-b4c3-db322d867204 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.184007 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5cfdb-858d-4008-99b7-28ee6bf5fd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.184885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5cfdb-858d-4008-99b7-28ee6bf5fd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.185173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5cfdb-858d-4008-99b7-28ee6bf5fd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.185584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5cfdb-858d-4008-99b7-28ee6bf5fd36 admin admin] PATH_INFO: `/v3/projects/58d6f616ed8d4fc38eb502661fc6d063/users/91f0e3f011834696a032728b97267d20/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.200533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5cfdb-858d-4008-99b7-28ee6bf5fd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d6f616ed8d4fc38eb502661fc6d063, user_id=91f0e3f011834696a032728b97267d20, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.203774 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5cfdb-858d-4008-99b7-28ee6bf5fd36 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.216339 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1255/2543] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:25 2022] PUT /identity/v3/projects/58d6f616ed8d4fc38eb502661fc6d063/users/91f0e3f011834696a032728b97267d20/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:25.227195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c94d-94b2-4434-9c8f-94bff4daeaee None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.227533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c94d-94b2-4434-9c8f-94bff4daeaee None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.227806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c94d-94b2-4434-9c8f-94bff4daeaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.253296 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fa81c94d-94b2-4434-9c8f-94bff4daeaee None None] MFA Rules not processed for user `91f0e3f011834696a032728b97267d20`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:25.254607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fa81c94d-94b2-4434-9c8f-94bff4daeaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:25.320033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1289/2544] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:25.324484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5cfdb-858d-4008-99b7-28ee6bf5fd36 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.357765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:25.392619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5cfdb-858d-4008-99b7-28ee6bf5fd36 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.397290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893d969-e175-4fe1-bd57-96c9f6531f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.397957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893d969-e175-4fe1-bd57-96c9f6531f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.398246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893d969-e175-4fe1-bd57-96c9f6531f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.398528 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893d969-e175-4fe1-bd57-96c9f6531f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.399222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893d969-e175-4fe1-bd57-96c9f6531f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.401157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893d969-e175-4fe1-bd57-96c9f6531f58 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.426720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1256/2545] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:25 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:25.431084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81c94d-94b2-4434-9c8f-94bff4daeaee None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.442637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81c94d-94b2-4434-9c8f-94bff4daeaee None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.462577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:25.500382 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc97bf-d5be-4569-9e09-9dd095a064ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.501055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc97bf-d5be-4569-9e09-9dd095a064ac admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.501336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc97bf-d5be-4569-9e09-9dd095a064ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.501608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc97bf-d5be-4569-9e09-9dd095a064ac admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.502322 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc97bf-d5be-4569-9e09-9dd095a064ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.504282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc97bf-d5be-4569-9e09-9dd095a064ac admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.523872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1290/2546] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:25 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:25.527801 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893d969-e175-4fe1-bd57-96c9f6531f58 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.537836 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893d969-e175-4fe1-bd57-96c9f6531f58 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.542376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7fcd2-68c9-497b-ab86-90bcf844f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.543034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7fcd2-68c9-497b-ab86-90bcf844f244 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.543316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7fcd2-68c9-497b-ab86-90bcf844f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.543620 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7fcd2-68c9-497b-ab86-90bcf844f244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.544346 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7fcd2-68c9-497b-ab86-90bcf844f244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.545966 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7fcd2-68c9-497b-ab86-90bcf844f244 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.556310 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1257/2547] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:25.560180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc97bf-d5be-4569-9e09-9dd095a064ac admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.570894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc97bf-d5be-4569-9e09-9dd095a064ac admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.575587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68087355-ba36-41ca-b9ed-41df2d2f71fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.577056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68087355-ba36-41ca-b9ed-41df2d2f71fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.577338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68087355-ba36-41ca-b9ed-41df2d2f71fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.577640 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68087355-ba36-41ca-b9ed-41df2d2f71fa admin admin] PATH_INFO: `/v3/projects/bfb6cde8bdb547c7aeb6b5606b8f0d11/users/d9220392b6bc43b7bc4a4d712b7e8970/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.592204 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68087355-ba36-41ca-b9ed-41df2d2f71fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb6cde8bdb547c7aeb6b5606b8f0d11, user_id=d9220392b6bc43b7bc4a4d712b7e8970, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.595013 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68087355-ba36-41ca-b9ed-41df2d2f71fa admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.607789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1291/2548] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:25 2022] PUT /identity/v3/projects/bfb6cde8bdb547c7aeb6b5606b8f0d11/users/d9220392b6bc43b7bc4a4d712b7e8970/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:25.611621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7fcd2-68c9-497b-ab86-90bcf844f244 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.621754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7fcd2-68c9-497b-ab86-90bcf844f244 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.678819 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0021a74-df3b-44c8-b66c-74df197a4ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.679517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0021a74-df3b-44c8-b66c-74df197a4ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.679808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0021a74-df3b-44c8-b66c-74df197a4ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.680086 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0021a74-df3b-44c8-b66c-74df197a4ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.680813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0021a74-df3b-44c8-b66c-74df197a4ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.682396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0021a74-df3b-44c8-b66c-74df197a4ae9 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.692899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1258/2549] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:25.697040 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68087355-ba36-41ca-b9ed-41df2d2f71fa admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.707844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68087355-ba36-41ca-b9ed-41df2d2f71fa admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.712451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72509cf4-3395-4a68-9b1d-bcd8804fb896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.713333 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509cf4-3395-4a68-9b1d-bcd8804fb896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.713616 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509cf4-3395-4a68-9b1d-bcd8804fb896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.713893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72509cf4-3395-4a68-9b1d-bcd8804fb896 admin admin] PATH_INFO: `/v3/projects/bfb6cde8bdb547c7aeb6b5606b8f0d11/users/d9220392b6bc43b7bc4a4d712b7e8970/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.715906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72509cf4-3395-4a68-9b1d-bcd8804fb896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb6cde8bdb547c7aeb6b5606b8f0d11, user_id=d9220392b6bc43b7bc4a4d712b7e8970, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.719182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72509cf4-3395-4a68-9b1d-bcd8804fb896 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.729581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1292/2550] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:25 2022] PUT /identity/v3/projects/bfb6cde8bdb547c7aeb6b5606b8f0d11/users/d9220392b6bc43b7bc4a4d712b7e8970/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:25.739666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83879832-febe-4eec-b18a-edff28ccda08 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.739965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83879832-febe-4eec-b18a-edff28ccda08 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.740249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83879832-febe-4eec-b18a-edff28ccda08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.766562 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-83879832-febe-4eec-b18a-edff28ccda08 None None] MFA Rules not processed for user `d9220392b6bc43b7bc4a4d712b7e8970`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:25.767808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-83879832-febe-4eec-b18a-edff28ccda08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:25.834784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1259/2551] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:25.846680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72509cf4-3395-4a68-9b1d-bcd8804fb896 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:25.848408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-72509cf4-3395-4a68-9b1d-bcd8804fb896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:25.903243 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72509cf4-3395-4a68-9b1d-bcd8804fb896 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:25.907459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788c7d3-d41d-46d2-8733-dfd1d73361c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:25.908089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788c7d3-d41d-46d2-8733-dfd1d73361c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:25.908370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788c7d3-d41d-46d2-8733-dfd1d73361c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:25.908641 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788c7d3-d41d-46d2-8733-dfd1d73361c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:25.917436 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788c7d3-d41d-46d2-8733-dfd1d73361c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:25.918836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788c7d3-d41d-46d2-8733-dfd1d73361c2 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:25.928129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1293/2552] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:25.993240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83879832-febe-4eec-b18a-edff28ccda08 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:26.018256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:26.057825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83879832-febe-4eec-b18a-edff28ccda08 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:26.063187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:26.064088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:26.064374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:26.064647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] PATH_INFO: `/v3/users/91f0e3f011834696a032728b97267d20` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:26.065841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f0e3f011834696a032728b97267d20)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:26.067775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:26.105638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788c7d3-d41d-46d2-8733-dfd1d73361c2 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:26.107353 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d788c7d3-d41d-46d2-8733-dfd1d73361c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:26.118337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f0e3f011834696a032728b97267d20'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.119016 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f0e3f011834696a032728b97267d20'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.129213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f0e3f011834696a032728b97267d20'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.129907 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f0e3f011834696a032728b97267d20'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.139040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-a4d9bbc9-ca58-46d1-ac0c-b12970c2db20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f0e3f011834696a032728b97267d20'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.159843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1260/2553] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:25 2022] DELETE /identity/v3/users/91f0e3f011834696a032728b97267d20 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:26.164543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff62dce-0748-4910-950d-a06d30b0482b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:26.164898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff62dce-0748-4910-950d-a06d30b0482b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:26.165250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff62dce-0748-4910-950d-a06d30b0482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:26.183155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6ff62dce-0748-4910-950d-a06d30b0482b None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:26.184385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6ff62dce-0748-4910-950d-a06d30b0482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:26.192283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788c7d3-d41d-46d2-8733-dfd1d73361c2 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:26.206032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:26.244679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1261/2554] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:26.255055 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff62dce-0748-4910-950d-a06d30b0482b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:26.256527 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6ff62dce-0748-4910-950d-a06d30b0482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:26.258650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:26.259308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:26.259634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:26.259917 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:26.261732 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:26.274214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:26.275841 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:26.286516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1294/2555] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:27:26.301986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:26.318187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff62dce-0748-4910-950d-a06d30b0482b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:26.321806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec3e93-a10f-4cc5-b5e3-33c1c50f30e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:26.322483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec3e93-a10f-4cc5-b5e3-33c1c50f30e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:26.322761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec3e93-a10f-4cc5-b5e3-33c1c50f30e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:26.323035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec3e93-a10f-4cc5-b5e3-33c1c50f30e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:26.332878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec3e93-a10f-4cc5-b5e3-33c1c50f30e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:26.334299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec3e93-a10f-4cc5-b5e3-33c1c50f30e5 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:26.344312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1262/2556] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:27:26.635035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:26.636719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:26.653630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583df4ca-2be1-4ca9-a208-33af36d08f33 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:26.676437 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:26.677338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:26.677625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:26.677904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] PATH_INFO: `/v3/projects/58d6f616ed8d4fc38eb502661fc6d063` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:26.679138 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d6f616ed8d4fc38eb502661fc6d063)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:26.681069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:26.728052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d6f616ed8d4fc38eb502661fc6d063', 'request_id': 'req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.735719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d6f616ed8d4fc38eb502661fc6d063', 'request_id': 'req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.741379 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d6f616ed8d4fc38eb502661fc6d063', 'request_id': 'req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.752988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] The token cache is being invalidate because project 58d6f616ed8d4fc38eb502661fc6d063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:26.753275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.753910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.755458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1295/2557] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:26 2022] DELETE /identity/v3/projects/58d6f616ed8d4fc38eb502661fc6d063 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:26.759558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec3e93-a10f-4cc5-b5e3-33c1c50f30e5 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:26.769195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec3e93-a10f-4cc5-b5e3-33c1c50f30e5 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:26.824619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:26.825488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:26.825772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:26.826072 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] PATH_INFO: `/v3/users/d9220392b6bc43b7bc4a4d712b7e8970` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:26.827427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9220392b6bc43b7bc4a4d712b7e8970)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:26.829350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:26.875212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9220392b6bc43b7bc4a4d712b7e8970'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.875882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9220392b6bc43b7bc4a4d712b7e8970'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.882688 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9220392b6bc43b7bc4a4d712b7e8970'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.883255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9220392b6bc43b7bc4a4d712b7e8970'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.890178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-1ef540d4-4d49-4f87-a766-c09cc8879fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9220392b6bc43b7bc4a4d712b7e8970'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:26.907566 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1263/2558] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:26 2022] DELETE /identity/v3/users/d9220392b6bc43b7bc4a4d712b7e8970 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:27.180525 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:27.181985 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:27.197192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc0cd9-1c37-426d-9a1f-839aff7c47ef admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:27.254167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:27.255032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.255318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.255636 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] PATH_INFO: `/v3/projects/bfb6cde8bdb547c7aeb6b5606b8f0d11` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.256821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb6cde8bdb547c7aeb6b5606b8f0d11)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:27.258725 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:27.290214 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:27.306934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb6cde8bdb547c7aeb6b5606b8f0d11', 'request_id': 'req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:27.314072 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb6cde8bdb547c7aeb6b5606b8f0d11', 'request_id': 'req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:27.319813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb6cde8bdb547c7aeb6b5606b8f0d11', 'request_id': 'req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:27.331443 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] The token cache is being invalidate because project bfb6cde8bdb547c7aeb6b5606b8f0d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:27.331739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:27.332370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a1d1c0f1-dda0-4c4f-96e0-750ae7a19c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:27.333949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1296/2559] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:27 2022] DELETE /identity/v3/projects/bfb6cde8bdb547c7aeb6b5606b8f0d11 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:27.338832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c796-231d-44fa-a273-a98af28f20a4 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.339285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c796-231d-44fa-a273-a98af28f20a4 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.339407 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c796-231d-44fa-a273-a98af28f20a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.358373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-5974c796-231d-44fa-a273-a98af28f20a4 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:27.359619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5974c796-231d-44fa-a273-a98af28f20a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:27.418573 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1264/2560] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:27.427587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520af0a-117d-4f01-9149-751a91f5ce49 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.427813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520af0a-117d-4f01-9149-751a91f5ce49 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.428217 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520af0a-117d-4f01-9149-751a91f5ce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.446487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d520af0a-117d-4f01-9149-751a91f5ce49 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:27.447719 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d520af0a-117d-4f01-9149-751a91f5ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:27.456097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1297/2561] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:27.460214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974c796-231d-44fa-a273-a98af28f20a4 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:27.466218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:27.471114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974c796-231d-44fa-a273-a98af28f20a4 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:27.477185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa8609-1698-4ac4-9ea7-85109e2f0ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:27.478019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa8609-1698-4ac4-9ea7-85109e2f0ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.478510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa8609-1698-4ac4-9ea7-85109e2f0ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.479293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa8609-1698-4ac4-9ea7-85109e2f0ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.480119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa8609-1698-4ac4-9ea7-85109e2f0ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:27:27.480430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa8609-1698-4ac4-9ea7-85109e2f0ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:27.482062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa8609-1698-4ac4-9ea7-85109e2f0ee0 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:27.494214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1265/2562] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:27:27.498374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520af0a-117d-4f01-9149-751a91f5ce49 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:27.507780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520af0a-117d-4f01-9149-751a91f5ce49 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:27.512409 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6cf7-1d72-4bc4-9c83-d36784c13453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:27.513055 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6cf7-1d72-4bc4-9c83-d36784c13453 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.513847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6cf7-1d72-4bc4-9c83-d36784c13453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.514122 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd6cf7-1d72-4bc4-9c83-d36784c13453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.514823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd6cf7-1d72-4bc4-9c83-d36784c13453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:27.516729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd6cf7-1d72-4bc4-9c83-d36784c13453 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:27.541550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1298/2563] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:27 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:27.545548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa8609-1698-4ac4-9ea7-85109e2f0ee0 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:27.555584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa8609-1698-4ac4-9ea7-85109e2f0ee0 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:27.612321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbd947-cc1a-4097-b8b1-83dada0b5e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:27.612991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbd947-cc1a-4097-b8b1-83dada0b5e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.613279 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbd947-cc1a-4097-b8b1-83dada0b5e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.613556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbd947-cc1a-4097-b8b1-83dada0b5e4f admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.614242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbd947-cc1a-4097-b8b1-83dada0b5e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:27.616197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbd947-cc1a-4097-b8b1-83dada0b5e4f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:27.635930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1266/2564] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:27 2022] POST /identity/v3/users => generated 281 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:27.640477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6cf7-1d72-4bc4-9c83-d36784c13453 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:27.650536 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd6cf7-1d72-4bc4-9c83-d36784c13453 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:27.655057 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f1463-bb9b-4b17-ae31-d6b1750fee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:27.655753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f1463-bb9b-4b17-ae31-d6b1750fee36 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.656038 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f1463-bb9b-4b17-ae31-d6b1750fee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.656316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f1463-bb9b-4b17-ae31-d6b1750fee36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.657041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f1463-bb9b-4b17-ae31-d6b1750fee36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:27.658613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f1463-bb9b-4b17-ae31-d6b1750fee36 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:27.668750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1299/2565] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:27:27.672337 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbd947-cc1a-4097-b8b1-83dada0b5e4f admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:27.682403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbd947-cc1a-4097-b8b1-83dada0b5e4f admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:27.687607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c0edd-b363-470b-8688-366415306ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:27.688514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c0edd-b363-470b-8688-366415306ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.688793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c0edd-b363-470b-8688-366415306ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.689065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c0edd-b363-470b-8688-366415306ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.689790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c0edd-b363-470b-8688-366415306ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:27.691452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c0edd-b363-470b-8688-366415306ff4 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:27.705194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1267/2566] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:27:27.706388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f1463-bb9b-4b17-ae31-d6b1750fee36 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:27.716572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f1463-bb9b-4b17-ae31-d6b1750fee36 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:27.721343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b171cd-4350-49d0-8848-f244a4b069db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:27.722267 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b171cd-4350-49d0-8848-f244a4b069db admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.722554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b171cd-4350-49d0-8848-f244a4b069db admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.722834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b171cd-4350-49d0-8848-f244a4b069db admin admin] PATH_INFO: `/v3/projects/b7f28828488445dabc269b59f6310f5c/users/0648ec9998b84b9f96503902e320fa07/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.739384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b171cd-4350-49d0-8848-f244a4b069db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f28828488445dabc269b59f6310f5c, user_id=0648ec9998b84b9f96503902e320fa07, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:27.742112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b171cd-4350-49d0-8848-f244a4b069db admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:27.759007 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1300/2567] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:27 2022] PUT /identity/v3/projects/b7f28828488445dabc269b59f6310f5c/users/0648ec9998b84b9f96503902e320fa07/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:27.769938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a7b1-7d6c-43b2-8427-235c750e4c3c None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.770233 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a7b1-7d6c-43b2-8427-235c750e4c3c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.770524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a7b1-7d6c-43b2-8427-235c750e4c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.797006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-8899a7b1-7d6c-43b2-8427-235c750e4c3c None None] MFA Rules not processed for user `0648ec9998b84b9f96503902e320fa07`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:27.798249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-8899a7b1-7d6c-43b2-8427-235c750e4c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:27.864576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1268/2568] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:27.894929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b171cd-4350-49d0-8848-f244a4b069db admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:27.896765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-16b171cd-4350-49d0-8848-f244a4b069db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:27.953215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b171cd-4350-49d0-8848-f244a4b069db admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:27.956905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df38b30-524c-4774-9331-2aab58fb0fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:27.957548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df38b30-524c-4774-9331-2aab58fb0fde service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:27.957834 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df38b30-524c-4774-9331-2aab58fb0fde service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:27.958115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df38b30-524c-4774-9331-2aab58fb0fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:27.966401 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df38b30-524c-4774-9331-2aab58fb0fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:27.967868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df38b30-524c-4774-9331-2aab58fb0fde service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:27.976653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1301/2569] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:27.990570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899a7b1-7d6c-43b2-8427-235c750e4c3c None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:28.052879 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899a7b1-7d6c-43b2-8427-235c750e4c3c None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:28.057551 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:28.058430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.058719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.059000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] PATH_INFO: `/v3/users/0648ec9998b84b9f96503902e320fa07` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.060837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0648ec9998b84b9f96503902e320fa07)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:28.063011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:28.064508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:28.110985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0648ec9998b84b9f96503902e320fa07'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.111665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0648ec9998b84b9f96503902e320fa07'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.118497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0648ec9998b84b9f96503902e320fa07'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.119144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0648ec9998b84b9f96503902e320fa07'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.130098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8cc2ba3c-67a2-49a6-bff3-5e94bc68cb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0648ec9998b84b9f96503902e320fa07'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.149074 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1269/2570] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:27 2022] DELETE /identity/v3/users/0648ec9998b84b9f96503902e320fa07 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:28.153614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21383cd9-365a-49db-993c-a36e173af040 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.153922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21383cd9-365a-49db-993c-a36e173af040 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.154210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21383cd9-365a-49db-993c-a36e173af040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.172774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-21383cd9-365a-49db-993c-a36e173af040 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:28.173956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-21383cd9-365a-49db-993c-a36e173af040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:28.175994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264e3f-31cb-461d-8f1b-3ace01e7bff0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.176289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264e3f-31cb-461d-8f1b-3ace01e7bff0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.176572 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99264e3f-31cb-461d-8f1b-3ace01e7bff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.194504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-99264e3f-31cb-461d-8f1b-3ace01e7bff0 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:28.195751 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-99264e3f-31cb-461d-8f1b-3ace01e7bff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:28.224915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:28.238674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1302/2571] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:28.249647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21383cd9-365a-49db-993c-a36e173af040 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:28.250959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-21383cd9-365a-49db-993c-a36e173af040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:28.252439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1270/2572] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jun 7 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:28.264805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99264e3f-31cb-461d-8f1b-3ace01e7bff0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:28.266191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-99264e3f-31cb-461d-8f1b-3ace01e7bff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:28.308583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21383cd9-365a-49db-993c-a36e173af040 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:28.312222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead5e2d-d64e-4ef9-9cff-2862ef2f6425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:28.313124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead5e2d-d64e-4ef9-9cff-2862ef2f6425 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.313406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead5e2d-d64e-4ef9-9cff-2862ef2f6425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.313679 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead5e2d-d64e-4ef9-9cff-2862ef2f6425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.322673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead5e2d-d64e-4ef9-9cff-2862ef2f6425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:28.324136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead5e2d-d64e-4ef9-9cff-2862ef2f6425 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:28.334212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1303/2573] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:27:28.334947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99264e3f-31cb-461d-8f1b-3ace01e7bff0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:28.340358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1430c-ad6f-4606-88eb-064755b357e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:28.341094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1430c-ad6f-4606-88eb-064755b357e2 service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.341985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1430c-ad6f-4606-88eb-064755b357e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.342270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1430c-ad6f-4606-88eb-064755b357e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.351300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1430c-ad6f-4606-88eb-064755b357e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:28.352960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1430c-ad6f-4606-88eb-064755b357e2 service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:28.362200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1271/2574] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:27:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 07 14:27:28.617300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead5e2d-d64e-4ef9-9cff-2862ef2f6425 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:28.618865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8ead5e2d-d64e-4ef9-9cff-2862ef2f6425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:28.633560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead5e2d-d64e-4ef9-9cff-2862ef2f6425 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:28.638681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:28.639472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.639820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.640109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] PATH_INFO: `/v3/projects/b7f28828488445dabc269b59f6310f5c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.641499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f28828488445dabc269b59f6310f5c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:28.643901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:28.693407 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f28828488445dabc269b59f6310f5c', 'request_id': 'req-17fca79a-1e03-497b-b077-99b55f8b2bb8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.702600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f28828488445dabc269b59f6310f5c', 'request_id': 'req-17fca79a-1e03-497b-b077-99b55f8b2bb8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.708159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f28828488445dabc269b59f6310f5c', 'request_id': 'req-17fca79a-1e03-497b-b077-99b55f8b2bb8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.719630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] The token cache is being invalidate because project b7f28828488445dabc269b59f6310f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:28.719911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.720547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-17fca79a-1e03-497b-b077-99b55f8b2bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:28.722320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1304/2575] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:28 2022] DELETE /identity/v3/projects/b7f28828488445dabc269b59f6310f5c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:28.727125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f06f-6db7-4219-a4eb-4718660464b1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.727446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f06f-6db7-4219-a4eb-4718660464b1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.727794 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295f06f-6db7-4219-a4eb-4718660464b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.746318 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a295f06f-6db7-4219-a4eb-4718660464b1 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:28.748203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a295f06f-6db7-4219-a4eb-4718660464b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:28.756853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:28.810026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1272/2576] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:28.818770 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dfbb2-d28c-4251-b126-7b7d1e541820 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.819059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dfbb2-d28c-4251-b126-7b7d1e541820 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.819363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dfbb2-d28c-4251-b126-7b7d1e541820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.838630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b60dfbb2-d28c-4251-b126-7b7d1e541820 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:28.839879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b60dfbb2-d28c-4251-b126-7b7d1e541820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:28.848085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1305/2577] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:28.852758 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295f06f-6db7-4219-a4eb-4718660464b1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:28.862944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295f06f-6db7-4219-a4eb-4718660464b1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:28.868312 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc7a97-c035-433a-b09e-80709f60458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:28.868982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc7a97-c035-433a-b09e-80709f60458f admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.869265 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc7a97-c035-433a-b09e-80709f60458f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.869539 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc7a97-c035-433a-b09e-80709f60458f admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.870324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc7a97-c035-433a-b09e-80709f60458f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:27:28.870572 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc7a97-c035-433a-b09e-80709f60458f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:28.872169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc7a97-c035-433a-b09e-80709f60458f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:28.888584 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1273/2578] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:27:28.889771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dfbb2-d28c-4251-b126-7b7d1e541820 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:28.899622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dfbb2-d28c-4251-b126-7b7d1e541820 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:28.904780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac603b-e0eb-4ba8-9312-e0a8f897103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:28.905490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac603b-e0eb-4ba8-9312-e0a8f897103a admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:28.906035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac603b-e0eb-4ba8-9312-e0a8f897103a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:28.906287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac603b-e0eb-4ba8-9312-e0a8f897103a admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:28.907120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac603b-e0eb-4ba8-9312-e0a8f897103a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:28.909160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac603b-e0eb-4ba8-9312-e0a8f897103a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:28.938999 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1306/2579] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:28 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:28.943020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc7a97-c035-433a-b09e-80709f60458f admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:28.953855 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc7a97-c035-433a-b09e-80709f60458f admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:29.013542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc4b03-7db0-4a65-8196-38ca04a44662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:29.014145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc4b03-7db0-4a65-8196-38ca04a44662 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:29.014432 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc4b03-7db0-4a65-8196-38ca04a44662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:29.014708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc4b03-7db0-4a65-8196-38ca04a44662 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:29.015441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc4b03-7db0-4a65-8196-38ca04a44662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:29.017416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc4b03-7db0-4a65-8196-38ca04a44662 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:29.037839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1274/2580] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:28 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:29.045755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac603b-e0eb-4ba8-9312-e0a8f897103a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:29.056018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac603b-e0eb-4ba8-9312-e0a8f897103a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:29.060682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ae412-3d94-4030-8eb9-25af139fe45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:29.061339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ae412-3d94-4030-8eb9-25af139fe45c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:29.061625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ae412-3d94-4030-8eb9-25af139fe45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:29.061903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ae412-3d94-4030-8eb9-25af139fe45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:29.062632 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ae412-3d94-4030-8eb9-25af139fe45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:29.064494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ae412-3d94-4030-8eb9-25af139fe45c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:29.074706 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1307/2581] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:29.078439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc4b03-7db0-4a65-8196-38ca04a44662 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:29.088243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc4b03-7db0-4a65-8196-38ca04a44662 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:29.093301 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7ffc3-90e1-4032-9cb8-abeb2a8567f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:29.093946 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7ffc3-90e1-4032-9cb8-abeb2a8567f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:29.094227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7ffc3-90e1-4032-9cb8-abeb2a8567f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:29.094501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7ffc3-90e1-4032-9cb8-abeb2a8567f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:29.095220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7ffc3-90e1-4032-9cb8-abeb2a8567f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:29.096838 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7ffc3-90e1-4032-9cb8-abeb2a8567f4 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:29.108568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1275/2582] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:29.112885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ae412-3d94-4030-8eb9-25af139fe45c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:29.122818 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ae412-3d94-4030-8eb9-25af139fe45c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:29.128202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5643-e83e-479f-bd53-d7eb8af3a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:29.129073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5643-e83e-479f-bd53-d7eb8af3a843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:29.129355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5643-e83e-479f-bd53-d7eb8af3a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:29.129630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5643-e83e-479f-bd53-d7eb8af3a843 admin admin] PATH_INFO: `/v3/projects/95c1fb5959c94903ac465576ca390f64/users/436a96e973c64f8a953af548db1c1023/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:29.144457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed5643-e83e-479f-bd53-d7eb8af3a843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c1fb5959c94903ac465576ca390f64, user_id=436a96e973c64f8a953af548db1c1023, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:29.147158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed5643-e83e-479f-bd53-d7eb8af3a843 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:29.160255 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1308/2583] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:29 2022] PUT /identity/v3/projects/95c1fb5959c94903ac465576ca390f64/users/436a96e973c64f8a953af548db1c1023/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:29.171561 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128654-3012-4f15-800b-a451ad731b3b None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:29.171876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128654-3012-4f15-800b-a451ad731b3b None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:29.172153 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12128654-3012-4f15-800b-a451ad731b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:29.198100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-12128654-3012-4f15-800b-a451ad731b3b None None] MFA Rules not processed for user `436a96e973c64f8a953af548db1c1023`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:29.199507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-12128654-3012-4f15-800b-a451ad731b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:29.262474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1276/2584] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:29.272886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5643-e83e-479f-bd53-d7eb8af3a843 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:29.274657 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-95ed5643-e83e-479f-bd53-d7eb8af3a843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:29.301825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:29.339418 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5643-e83e-479f-bd53-d7eb8af3a843 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:29.343630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecca81b-481d-49b4-b668-214c182b7e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:29.344266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecca81b-481d-49b4-b668-214c182b7e58 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:29.344564 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecca81b-481d-49b4-b668-214c182b7e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:29.344821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecca81b-481d-49b4-b668-214c182b7e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:29.354803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecca81b-481d-49b4-b668-214c182b7e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:29.356251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecca81b-481d-49b4-b668-214c182b7e58 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:29.365485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1309/2585] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:27:32.310198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128654-3012-4f15-800b-a451ad731b3b None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:32.320144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:32.374120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12128654-3012-4f15-800b-a451ad731b3b None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:32.378606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:32.379508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:32.379793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:32.380070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] PATH_INFO: `/v3/users/436a96e973c64f8a953af548db1c1023` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:32.381243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436a96e973c64f8a953af548db1c1023)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:32.383146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:32.428431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436a96e973c64f8a953af548db1c1023'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.429082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436a96e973c64f8a953af548db1c1023'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.435936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436a96e973c64f8a953af548db1c1023'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.436557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436a96e973c64f8a953af548db1c1023'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.443625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436a96e973c64f8a953af548db1c1023'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.461414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1277/2586] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:32 2022] DELETE /identity/v3/users/436a96e973c64f8a953af548db1c1023 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:32.465851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ae820-346e-4877-85f0-3633e1816472 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:32.466287 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ae820-346e-4877-85f0-3633e1816472 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:32.466387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ae820-346e-4877-85f0-3633e1816472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:32.483733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f43ae820-346e-4877-85f0-3633e1816472 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:32.484949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f43ae820-346e-4877-85f0-3633e1816472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:32.544312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1310/2587] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:32.553751 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:32.555162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:32.611490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be601b3-4891-4fd0-ac84-318dbed575e2 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:32.615065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30d53b-4319-4f9f-a722-69037456a593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:32.615742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30d53b-4319-4f9f-a722-69037456a593 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:32.616030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30d53b-4319-4f9f-a722-69037456a593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:32.616308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30d53b-4319-4f9f-a722-69037456a593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:32.625200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30d53b-4319-4f9f-a722-69037456a593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:32.626659 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30d53b-4319-4f9f-a722-69037456a593 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:32.636133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1278/2588] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:32.896082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ae820-346e-4877-85f0-3633e1816472 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:32.897498 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f43ae820-346e-4877-85f0-3633e1816472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:32.911623 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ae820-346e-4877-85f0-3633e1816472 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:32.916262 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:32.917160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:32.917444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:32.917717 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] PATH_INFO: `/v3/projects/95c1fb5959c94903ac465576ca390f64` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:32.919032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c1fb5959c94903ac465576ca390f64)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:32.921050 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:32.967680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c1fb5959c94903ac465576ca390f64', 'request_id': 'req-a3b9c813-d459-4a60-802d-df8c972a7cd1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.974729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c1fb5959c94903ac465576ca390f64', 'request_id': 'req-a3b9c813-d459-4a60-802d-df8c972a7cd1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.980286 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c1fb5959c94903ac465576ca390f64', 'request_id': 'req-a3b9c813-d459-4a60-802d-df8c972a7cd1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.991233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] The token cache is being invalidate because project 95c1fb5959c94903ac465576ca390f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:32.991558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.992199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a3b9c813-d459-4a60-802d-df8c972a7cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:32.993742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1311/2589] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:32 2022] DELETE /identity/v3/projects/95c1fb5959c94903ac465576ca390f64 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:32.999427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb22dc-ac78-4e28-9c50-4de0256fc012 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:32.999715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb22dc-ac78-4e28-9c50-4de0256fc012 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.000017 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb22dc-ac78-4e28-9c50-4de0256fc012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.017968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-c5bb22dc-ac78-4e28-9c50-4de0256fc012 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:33.019162 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c5bb22dc-ac78-4e28-9c50-4de0256fc012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:33.044359 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:33.079800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1279/2590] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:33.087092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473359a2-721e-4d73-8fe7-6979475b3b92 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:33.087430 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473359a2-721e-4d73-8fe7-6979475b3b92 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.087721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473359a2-721e-4d73-8fe7-6979475b3b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.105662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-473359a2-721e-4d73-8fe7-6979475b3b92 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:33.106868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-473359a2-721e-4d73-8fe7-6979475b3b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:33.114767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1312/2591] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:33.118695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb22dc-ac78-4e28-9c50-4de0256fc012 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:33.128937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb22dc-ac78-4e28-9c50-4de0256fc012 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:33.133533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525506f6-6d35-4ee1-80f9-ac832f6e27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:33.134180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525506f6-6d35-4ee1-80f9-ac832f6e27c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:33.134473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525506f6-6d35-4ee1-80f9-ac832f6e27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.134748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525506f6-6d35-4ee1-80f9-ac832f6e27c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.135547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525506f6-6d35-4ee1-80f9-ac832f6e27c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:27:33.135868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525506f6-6d35-4ee1-80f9-ac832f6e27c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:33.138441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525506f6-6d35-4ee1-80f9-ac832f6e27c2 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:33.150477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1280/2592] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:27:33.154544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473359a2-721e-4d73-8fe7-6979475b3b92 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:33.163879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473359a2-721e-4d73-8fe7-6979475b3b92 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:33.168494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab990-f74c-49d0-b0b9-f39658d1b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:33.169132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab990-f74c-49d0-b0b9-f39658d1b5af admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:33.169412 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab990-f74c-49d0-b0b9-f39658d1b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.169684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ab990-f74c-49d0-b0b9-f39658d1b5af admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.170864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ab990-f74c-49d0-b0b9-f39658d1b5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:33.172762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ab990-f74c-49d0-b0b9-f39658d1b5af admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:33.198400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1313/2593] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:33 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:33.202470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525506f6-6d35-4ee1-80f9-ac832f6e27c2 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:33.212421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525506f6-6d35-4ee1-80f9-ac832f6e27c2 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:33.268853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1540-4128-40d0-ba2c-1c8c22ed0285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:33.269548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1540-4128-40d0-ba2c-1c8c22ed0285 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:33.269835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1540-4128-40d0-ba2c-1c8c22ed0285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.270111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f1540-4128-40d0-ba2c-1c8c22ed0285 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.270795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f1540-4128-40d0-ba2c-1c8c22ed0285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:33.272729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f1540-4128-40d0-ba2c-1c8c22ed0285 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:33.291751 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1281/2594] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:33 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:33.296464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab990-f74c-49d0-b0b9-f39658d1b5af admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:33.307178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ab990-f74c-49d0-b0b9-f39658d1b5af admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:33.312380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30470e02-cbc0-4721-ac64-e9c525f2c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:33.313295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30470e02-cbc0-4721-ac64-e9c525f2c3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:33.313579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30470e02-cbc0-4721-ac64-e9c525f2c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.313856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30470e02-cbc0-4721-ac64-e9c525f2c3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.314581 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30470e02-cbc0-4721-ac64-e9c525f2c3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:33.316188 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30470e02-cbc0-4721-ac64-e9c525f2c3ad admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:33.326350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1314/2595] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:33.330420 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1540-4128-40d0-ba2c-1c8c22ed0285 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:33.340441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f1540-4128-40d0-ba2c-1c8c22ed0285 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:33.345414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aeb93-f3c7-4339-8ec1-cea0a3afaeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:33.346128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aeb93-f3c7-4339-8ec1-cea0a3afaeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:33.346417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aeb93-f3c7-4339-8ec1-cea0a3afaeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.346718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aeb93-f3c7-4339-8ec1-cea0a3afaeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.347473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aeb93-f3c7-4339-8ec1-cea0a3afaeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:33.349073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449aeb93-f3c7-4339-8ec1-cea0a3afaeb9 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:33.360203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1282/2596] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:33.364452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30470e02-cbc0-4721-ac64-e9c525f2c3ad admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:33.370879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:33.375488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30470e02-cbc0-4721-ac64-e9c525f2c3ad admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:33.381171 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda630-79e3-49bf-830f-9016a33a3a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:33.382052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda630-79e3-49bf-830f-9016a33a3a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:33.382556 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda630-79e3-49bf-830f-9016a33a3a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.383012 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda630-79e3-49bf-830f-9016a33a3a14 admin admin] PATH_INFO: `/v3/projects/7fd3d28107fc42d1bf7bf6bec5fbd926/users/d6bbe316f5f34b26a574aec882cab280/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.397665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bda630-79e3-49bf-830f-9016a33a3a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd3d28107fc42d1bf7bf6bec5fbd926, user_id=d6bbe316f5f34b26a574aec882cab280, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:33.400302 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bda630-79e3-49bf-830f-9016a33a3a14 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:33.412386 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1315/2597] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:33 2022] PUT /identity/v3/projects/7fd3d28107fc42d1bf7bf6bec5fbd926/users/d6bbe316f5f34b26a574aec882cab280/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:33.422947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e485645-4976-4353-8b84-9db452c380e0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:33.423271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e485645-4976-4353-8b84-9db452c380e0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.423581 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e485645-4976-4353-8b84-9db452c380e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.450247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1e485645-4976-4353-8b84-9db452c380e0 None None] MFA Rules not processed for user `d6bbe316f5f34b26a574aec882cab280`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:33.451475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1e485645-4976-4353-8b84-9db452c380e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:33.514511 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1283/2598] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:33.525582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda630-79e3-49bf-830f-9016a33a3a14 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:33.527273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-68bda630-79e3-49bf-830f-9016a33a3a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:33.583570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda630-79e3-49bf-830f-9016a33a3a14 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:33.587116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e0413-eae9-4940-8fdb-8da9ad35334c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:33.587789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e0413-eae9-4940-8fdb-8da9ad35334c service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:33.588071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e0413-eae9-4940-8fdb-8da9ad35334c service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:33.588346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e0413-eae9-4940-8fdb-8da9ad35334c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:33.597022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e0413-eae9-4940-8fdb-8da9ad35334c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:33.598422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e0413-eae9-4940-8fdb-8da9ad35334c service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:33.607250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1316/2599] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:43.511595 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:43.603362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:47.457028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e485645-4976-4353-8b84-9db452c380e0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:47.458491 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1e485645-4976-4353-8b84-9db452c380e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:47.547648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e485645-4976-4353-8b84-9db452c380e0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:47.553441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:47.554122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:47.554404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:47.554677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:47.556604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:47.571205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:47.572871 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:47.585262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1284/2600] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:27:52.638553 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e0413-eae9-4940-8fdb-8da9ad35334c service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:52.640103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ff2e0413-eae9-4940-8fdb-8da9ad35334c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:52.699959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e0413-eae9-4940-8fdb-8da9ad35334c service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:52.704264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:52.704912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:52.705200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:52.705478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:52.707313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:52.768838 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:52.770176 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:52.780315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1317/2601] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:55.603723 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:55.605195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:55.681944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:55.681944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:55.703044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad1499-6424-4433-b7ca-3724d538c1e7 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:55.708550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:55.709435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:55.709881 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:55.710164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] PATH_INFO: `/v3/users/05ba6d637a31453b88ba4c18b47697b6` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:55.711410 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ba6d637a31453b88ba4c18b47697b6)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:55.713319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:55.720693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d20f6-3ef1-44af-a525-61e56533c16f service nova] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:55.725782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b9451-da24-4190-9526-52e5ad28c23a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:55.726442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b9451-da24-4190-9526-52e5ad28c23a service placement] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:55.726783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b9451-da24-4190-9526-52e5ad28c23a service placement] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:55.727103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b9451-da24-4190-9526-52e5ad28c23a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:55.729495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5a7b9451-da24-4190-9526-52e5ad28c23a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:55.745027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b9451-da24-4190-9526-52e5ad28c23a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:55.746751 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b9451-da24-4190-9526-52e5ad28c23a service placement] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:55.763689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1285/2602] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:55.781271 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ba6d637a31453b88ba4c18b47697b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:55.789696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ba6d637a31453b88ba4c18b47697b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:55.791032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ba6d637a31453b88ba4c18b47697b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:55.798898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ba6d637a31453b88ba4c18b47697b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:55.812273 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4c5bff29-080d-4f81-bd82-5711c816be00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ba6d637a31453b88ba4c18b47697b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:55.818139 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1318/2603] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:27:55 2022] DELETE /identity/v3/users/05ba6d637a31453b88ba4c18b47697b6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:55.992444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b9451-da24-4190-9526-52e5ad28c23a service placement] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.008122 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b9451-da24-4190-9526-52e5ad28c23a service placement] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.086939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.087873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.088152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.088422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] PATH_INFO: `/v3/projects/e408c30513b14be489e6b72248f359cc` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.089601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e408c30513b14be489e6b72248f359cc)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.091552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.107293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:56.135590 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e408c30513b14be489e6b72248f359cc', 'request_id': 'req-adca52f0-c037-4719-b51c-fc3c4f4eee4c'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:56.142037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e408c30513b14be489e6b72248f359cc', 'request_id': 'req-adca52f0-c037-4719-b51c-fc3c4f4eee4c'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:56.148533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e408c30513b14be489e6b72248f359cc', 'request_id': 'req-adca52f0-c037-4719-b51c-fc3c4f4eee4c'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:56.158718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] The token cache is being invalidate because project e408c30513b14be489e6b72248f359cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:27:56.159001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:56.159650 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-adca52f0-c037-4719-b51c-fc3c4f4eee4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:27:56.161180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1286/2604] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:27:55 2022] DELETE /identity/v3/projects/e408c30513b14be489e6b72248f359cc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:56.166252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7019-de15-48da-a674-c54cb606bf31 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.166546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7019-de15-48da-a674-c54cb606bf31 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.166829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7019-de15-48da-a674-c54cb606bf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.184163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e6bf7019-de15-48da-a674-c54cb606bf31 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:56.185868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e6bf7019-de15-48da-a674-c54cb606bf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:56.203582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:56.245662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1319/2605] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:56.253748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6217f9-650c-4bf5-979b-85f968176d92 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.254040 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6217f9-650c-4bf5-979b-85f968176d92 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.254321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6217f9-650c-4bf5-979b-85f968176d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.275530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4e6217f9-650c-4bf5-979b-85f968176d92 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:56.277037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4e6217f9-650c-4bf5-979b-85f968176d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:56.286283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1287/2606] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:56.290551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7019-de15-48da-a674-c54cb606bf31 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.300391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7019-de15-48da-a674-c54cb606bf31 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.305048 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fa09b-edb9-4099-b483-c3b7e8c6748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.305713 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fa09b-edb9-4099-b483-c3b7e8c6748d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.305998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fa09b-edb9-4099-b483-c3b7e8c6748d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.306265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fa09b-edb9-4099-b483-c3b7e8c6748d admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.307028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fa09b-edb9-4099-b483-c3b7e8c6748d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:27:56.307331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fa09b-edb9-4099-b483-c3b7e8c6748d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.308993 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fa09b-edb9-4099-b483-c3b7e8c6748d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.321862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1320/2607] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:27:56.326719 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6217f9-650c-4bf5-979b-85f968176d92 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.336300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6217f9-650c-4bf5-979b-85f968176d92 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.341041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22891f8-8ee4-4c2d-9cea-384079c9e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.341704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22891f8-8ee4-4c2d-9cea-384079c9e68a admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.341989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22891f8-8ee4-4c2d-9cea-384079c9e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.342269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22891f8-8ee4-4c2d-9cea-384079c9e68a admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.342963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22891f8-8ee4-4c2d-9cea-384079c9e68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.344895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22891f8-8ee4-4c2d-9cea-384079c9e68a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.380001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1288/2608] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:56 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:56.384088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fa09b-edb9-4099-b483-c3b7e8c6748d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.394825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fa09b-edb9-4099-b483-c3b7e8c6748d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.450126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ca6c-b672-43bc-a634-38dda46f7867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.450796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ca6c-b672-43bc-a634-38dda46f7867 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.451078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ca6c-b672-43bc-a634-38dda46f7867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.451383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ca6c-b672-43bc-a634-38dda46f7867 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.452092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6ca6c-b672-43bc-a634-38dda46f7867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.453975 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6ca6c-b672-43bc-a634-38dda46f7867 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.472859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1321/2609] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:56 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:56.477038 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22891f8-8ee4-4c2d-9cea-384079c9e68a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.488124 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22891f8-8ee4-4c2d-9cea-384079c9e68a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.492854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25d3df-26be-458b-9120-b2709ebad0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.493522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d3df-26be-458b-9120-b2709ebad0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.493805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d3df-26be-458b-9120-b2709ebad0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.494080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25d3df-26be-458b-9120-b2709ebad0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.494817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25d3df-26be-458b-9120-b2709ebad0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.496563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25d3df-26be-458b-9120-b2709ebad0fc admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.507095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1289/2610] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:56.511103 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ca6c-b672-43bc-a634-38dda46f7867 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.521318 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ca6c-b672-43bc-a634-38dda46f7867 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.525952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0db03-c7e2-4c8b-b908-0c6993d5a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.526611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0db03-c7e2-4c8b-b908-0c6993d5a867 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.526897 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0db03-c7e2-4c8b-b908-0c6993d5a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.527180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0db03-c7e2-4c8b-b908-0c6993d5a867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.528153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0db03-c7e2-4c8b-b908-0c6993d5a867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.529839 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0db03-c7e2-4c8b-b908-0c6993d5a867 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.540024 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1322/2611] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:56.545042 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25d3df-26be-458b-9120-b2709ebad0fc admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.554984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25d3df-26be-458b-9120-b2709ebad0fc admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.560214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b0d3-bf97-4b56-98e0-3a000f337656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.561077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b0d3-bf97-4b56-98e0-3a000f337656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.561357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b0d3-bf97-4b56-98e0-3a000f337656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.561627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b0d3-bf97-4b56-98e0-3a000f337656 admin admin] PATH_INFO: `/v3/projects/975ed3f17ee54554892092ec70986e3a/users/cf874af0cff148818160493ed3751678/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.576499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01b0d3-bf97-4b56-98e0-3a000f337656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=975ed3f17ee54554892092ec70986e3a, user_id=cf874af0cff148818160493ed3751678, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.579120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01b0d3-bf97-4b56-98e0-3a000f337656 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.596980 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1290/2612] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:56 2022] PUT /identity/v3/projects/975ed3f17ee54554892092ec70986e3a/users/cf874af0cff148818160493ed3751678/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:27:56.608235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d02e3d-e578-4a8d-bb47-3d5541a79991 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.608533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d02e3d-e578-4a8d-bb47-3d5541a79991 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.608817 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d02e3d-e578-4a8d-bb47-3d5541a79991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.635789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-56d02e3d-e578-4a8d-bb47-3d5541a79991 None None] MFA Rules not processed for user `cf874af0cff148818160493ed3751678`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:56.637023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-56d02e3d-e578-4a8d-bb47-3d5541a79991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:56.699247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1323/2613] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:27:56.703760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b0d3-bf97-4b56-98e0-3a000f337656 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.764985 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b0d3-bf97-4b56-98e0-3a000f337656 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.769701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ac784-a6c7-406a-979e-c165d0b15494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.770356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ac784-a6c7-406a-979e-c165d0b15494 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.770644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ac784-a6c7-406a-979e-c165d0b15494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.770925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ac784-a6c7-406a-979e-c165d0b15494 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.771651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ac784-a6c7-406a-979e-c165d0b15494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.773543 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ac784-a6c7-406a-979e-c165d0b15494 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.798818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1291/2614] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:27:56 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:56.802857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d02e3d-e578-4a8d-bb47-3d5541a79991 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.813885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d02e3d-e578-4a8d-bb47-3d5541a79991 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.825943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:56.870909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56aa78-aae4-4b6d-af7c-22d5d253846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.871607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56aa78-aae4-4b6d-af7c-22d5d253846e admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.871919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56aa78-aae4-4b6d-af7c-22d5d253846e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.872231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56aa78-aae4-4b6d-af7c-22d5d253846e admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.872927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56aa78-aae4-4b6d-af7c-22d5d253846e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.874856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56aa78-aae4-4b6d-af7c-22d5d253846e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.894310 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1324/2615] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:27:56 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:27:56.897967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ac784-a6c7-406a-979e-c165d0b15494 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.909241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ac784-a6c7-406a-979e-c165d0b15494 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.914091 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c18b6-b0b6-4b07-8b7c-ed44b24df91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.914804 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c18b6-b0b6-4b07-8b7c-ed44b24df91c admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.915073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c18b6-b0b6-4b07-8b7c-ed44b24df91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.915376 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c18b6-b0b6-4b07-8b7c-ed44b24df91c admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.916125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c18b6-b0b6-4b07-8b7c-ed44b24df91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.917709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c18b6-b0b6-4b07-8b7c-ed44b24df91c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.929012 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1292/2616] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:56.933141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56aa78-aae4-4b6d-af7c-22d5d253846e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.943455 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56aa78-aae4-4b6d-af7c-22d5d253846e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.948244 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990be16-31f1-48cb-a20d-c119284fb2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:56.949155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990be16-31f1-48cb-a20d-c119284fb2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:56.949439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990be16-31f1-48cb-a20d-c119284fb2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:56.949742 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990be16-31f1-48cb-a20d-c119284fb2b6 admin admin] PATH_INFO: `/v3/projects/21414264608648aeb0caf53a2af5360a/users/10ea4fcb80e9428a8cd06a8ed44ee2c5/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:56.964395 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990be16-31f1-48cb-a20d-c119284fb2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21414264608648aeb0caf53a2af5360a, user_id=10ea4fcb80e9428a8cd06a8ed44ee2c5, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:56.967575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990be16-31f1-48cb-a20d-c119284fb2b6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:56.980623 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1325/2617] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:56 2022] PUT /identity/v3/projects/21414264608648aeb0caf53a2af5360a/users/10ea4fcb80e9428a8cd06a8ed44ee2c5/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:56.985092 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c18b6-b0b6-4b07-8b7c-ed44b24df91c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:56.994961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c18b6-b0b6-4b07-8b7c-ed44b24df91c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:56.998540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:27:57.054452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd0f84-8a2d-41a9-b190-f8d0d97bbfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:57.055050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd0f84-8a2d-41a9-b190-f8d0d97bbfcf admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:57.055362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd0f84-8a2d-41a9-b190-f8d0d97bbfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:57.055643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd0f84-8a2d-41a9-b190-f8d0d97bbfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:57.056367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd0f84-8a2d-41a9-b190-f8d0d97bbfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:57.057965 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd0f84-8a2d-41a9-b190-f8d0d97bbfcf admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:57.067989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1293/2618] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:27:57.072323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990be16-31f1-48cb-a20d-c119284fb2b6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:57.083291 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990be16-31f1-48cb-a20d-c119284fb2b6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:57.089769 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f044ff0-5421-4a31-99ee-04284da08c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:57.091304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f044ff0-5421-4a31-99ee-04284da08c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:57.091625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f044ff0-5421-4a31-99ee-04284da08c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:57.091904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f044ff0-5421-4a31-99ee-04284da08c40 admin admin] PATH_INFO: `/v3/projects/21414264608648aeb0caf53a2af5360a/users/10ea4fcb80e9428a8cd06a8ed44ee2c5/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:57.093907 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f044ff0-5421-4a31-99ee-04284da08c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21414264608648aeb0caf53a2af5360a, user_id=10ea4fcb80e9428a8cd06a8ed44ee2c5, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:57.096558 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f044ff0-5421-4a31-99ee-04284da08c40 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:57.108185 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1326/2619] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:27:57 2022] PUT /identity/v3/projects/21414264608648aeb0caf53a2af5360a/users/10ea4fcb80e9428a8cd06a8ed44ee2c5/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:27:57.118322 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240cece-b8ce-46f7-8a7f-935c3ad689a1 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:57.118618 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240cece-b8ce-46f7-8a7f-935c3ad689a1 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:57.118898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240cece-b8ce-46f7-8a7f-935c3ad689a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:57.145451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-0240cece-b8ce-46f7-8a7f-935c3ad689a1 None None] MFA Rules not processed for user `10ea4fcb80e9428a8cd06a8ed44ee2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:27:57.146667 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0240cece-b8ce-46f7-8a7f-935c3ad689a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:57.214450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1294/2620] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:27:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:27:57.226422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f044ff0-5421-4a31-99ee-04284da08c40 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:57.228242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9f044ff0-5421-4a31-99ee-04284da08c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:27:57.284656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f044ff0-5421-4a31-99ee-04284da08c40 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:57.288649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7318ac7-0b37-4351-8a8b-cdda4c33138e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:57.289351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7318ac7-0b37-4351-8a8b-cdda4c33138e service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:57.289663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7318ac7-0b37-4351-8a8b-cdda4c33138e service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:57.289943 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7318ac7-0b37-4351-8a8b-cdda4c33138e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:57.298886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7318ac7-0b37-4351-8a8b-cdda4c33138e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:57.300332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7318ac7-0b37-4351-8a8b-cdda4c33138e service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:57.309879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1327/2621] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:27:57.384572 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240cece-b8ce-46f7-8a7f-935c3ad689a1 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:27:57.394882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240cece-b8ce-46f7-8a7f-935c3ad689a1 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:27:57.398825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76fca6-33e1-4efa-b0bc-d6b9da37049b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:27:57.399508 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76fca6-33e1-4efa-b0bc-d6b9da37049b service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:27:57.399877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76fca6-33e1-4efa-b0bc-d6b9da37049b service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:27:57.400173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76fca6-33e1-4efa-b0bc-d6b9da37049b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:27:57.456143 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76fca6-33e1-4efa-b0bc-d6b9da37049b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:27:57.457563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76fca6-33e1-4efa-b0bc-d6b9da37049b service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:27:57.466982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1295/2622] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:27:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:05.185399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7318ac7-0b37-4351-8a8b-cdda4c33138e service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:05.187071 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d7318ac7-0b37-4351-8a8b-cdda4c33138e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:05.251300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7318ac7-0b37-4351-8a8b-cdda4c33138e service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:05.255870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:05.256740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:05.257027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:05.257305 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] PATH_INFO: `/v3/users/d6bbe316f5f34b26a574aec882cab280` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:05.258489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bbe316f5f34b26a574aec882cab280)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:05.260555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:05.273702 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:05.307256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bbe316f5f34b26a574aec882cab280'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.314275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bbe316f5f34b26a574aec882cab280'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.314928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bbe316f5f34b26a574aec882cab280'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.321830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bbe316f5f34b26a574aec882cab280'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.334464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bbe316f5f34b26a574aec882cab280'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.340974 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1328/2623] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:05 2022] DELETE /identity/v3/users/d6bbe316f5f34b26a574aec882cab280 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:05.346150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26c69c-7687-4bc3-bb9c-d93b90e199e3 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:05.346635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26c69c-7687-4bc3-bb9c-d93b90e199e3 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:05.346742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26c69c-7687-4bc3-bb9c-d93b90e199e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:05.364002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-2b26c69c-7687-4bc3-bb9c-d93b90e199e3 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:05.365198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2b26c69c-7687-4bc3-bb9c-d93b90e199e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:05.385536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:05.424450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1296/2624] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:05.433896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:05.435316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:05.493338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e1e6-590a-4e57-a1b9-11001b5079e6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:05.497217 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb01770-9de2-443a-8426-420cddaaeedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:05.497882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01770-9de2-443a-8426-420cddaaeedf service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:05.498168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01770-9de2-443a-8426-420cddaaeedf service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:05.498995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01770-9de2-443a-8426-420cddaaeedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:05.508367 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb01770-9de2-443a-8426-420cddaaeedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:05.509798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb01770-9de2-443a-8426-420cddaaeedf service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:05.520159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1329/2625] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:28:05.801491 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26c69c-7687-4bc3-bb9c-d93b90e199e3 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:05.803493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2b26c69c-7687-4bc3-bb9c-d93b90e199e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:05.817118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26c69c-7687-4bc3-bb9c-d93b90e199e3 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:05.821839 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:05.822710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:05.822997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:05.823275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] PATH_INFO: `/v3/projects/7fd3d28107fc42d1bf7bf6bec5fbd926` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:05.824505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd3d28107fc42d1bf7bf6bec5fbd926)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:05.827324 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:05.873908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd3d28107fc42d1bf7bf6bec5fbd926', 'request_id': 'req-29f5de76-6543-47b5-b95f-c7866441ebce'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.880353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd3d28107fc42d1bf7bf6bec5fbd926', 'request_id': 'req-29f5de76-6543-47b5-b95f-c7866441ebce'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.887799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd3d28107fc42d1bf7bf6bec5fbd926', 'request_id': 'req-29f5de76-6543-47b5-b95f-c7866441ebce'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.899088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] The token cache is being invalidate because project 7fd3d28107fc42d1bf7bf6bec5fbd926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:05.899412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.900047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-29f5de76-6543-47b5-b95f-c7866441ebce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:05.901585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1297/2626] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:05 2022] DELETE /identity/v3/projects/7fd3d28107fc42d1bf7bf6bec5fbd926 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:05.907727 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d1c5-481c-4db0-bd48-0fb173beb1d4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:05.908025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d1c5-481c-4db0-bd48-0fb173beb1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:05.908311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8d1c5-481c-4db0-bd48-0fb173beb1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:05.927249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ecf8d1c5-481c-4db0-bd48-0fb173beb1d4 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:05.928523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ecf8d1c5-481c-4db0-bd48-0fb173beb1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:05.989520 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1330/2627] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:05.998106 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5e405-ed4d-410b-b7bd-3482afb11f8a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:05.998409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5e405-ed4d-410b-b7bd-3482afb11f8a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:05.998829 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5e405-ed4d-410b-b7bd-3482afb11f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:06.017786 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b3d5e405-ed4d-410b-b7bd-3482afb11f8a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:06.019001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b3d5e405-ed4d-410b-b7bd-3482afb11f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:06.026875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1298/2628] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:06.031127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8d1c5-481c-4db0-bd48-0fb173beb1d4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:06.040811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8d1c5-481c-4db0-bd48-0fb173beb1d4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:06.045340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9186ca-d3df-476b-a844-74860adbc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:06.045998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9186ca-d3df-476b-a844-74860adbc286 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:06.046282 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9186ca-d3df-476b-a844-74860adbc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:06.046560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9186ca-d3df-476b-a844-74860adbc286 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:06.047294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9186ca-d3df-476b-a844-74860adbc286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:28:06.047637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9186ca-d3df-476b-a844-74860adbc286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:06.049232 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9186ca-d3df-476b-a844-74860adbc286 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:06.061363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1331/2629] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:28:06.065881 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5e405-ed4d-410b-b7bd-3482afb11f8a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:06.075151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5e405-ed4d-410b-b7bd-3482afb11f8a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:06.080410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acb9c2-02c2-4205-b9f5-1cfd3fb98b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:06.081061 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acb9c2-02c2-4205-b9f5-1cfd3fb98b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:06.081362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acb9c2-02c2-4205-b9f5-1cfd3fb98b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:06.081632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acb9c2-02c2-4205-b9f5-1cfd3fb98b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:06.082321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acb9c2-02c2-4205-b9f5-1cfd3fb98b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:06.084240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acb9c2-02c2-4205-b9f5-1cfd3fb98b0e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:06.110487 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1299/2630] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:06 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:06.114579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9186ca-d3df-476b-a844-74860adbc286 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:06.125177 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9186ca-d3df-476b-a844-74860adbc286 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:06.145351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:06.184263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f097c-de1b-42cb-9734-9be0eb4384de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:06.184930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f097c-de1b-42cb-9734-9be0eb4384de admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:06.185295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f097c-de1b-42cb-9734-9be0eb4384de admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:06.186343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f097c-de1b-42cb-9734-9be0eb4384de admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:06.187029 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f097c-de1b-42cb-9734-9be0eb4384de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:06.188960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f097c-de1b-42cb-9734-9be0eb4384de admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:06.208338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1332/2631] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:06 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:06.212360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acb9c2-02c2-4205-b9f5-1cfd3fb98b0e admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:06.222544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acb9c2-02c2-4205-b9f5-1cfd3fb98b0e admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:06.227155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e1fa3-5868-47ce-9791-4b6d888a0792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:06.227845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e1fa3-5868-47ce-9791-4b6d888a0792 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:06.228134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e1fa3-5868-47ce-9791-4b6d888a0792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:06.228412 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e1fa3-5868-47ce-9791-4b6d888a0792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:06.229147 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e1fa3-5868-47ce-9791-4b6d888a0792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:06.230743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e1fa3-5868-47ce-9791-4b6d888a0792 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:06.241823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1300/2632] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:06.245454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f097c-de1b-42cb-9734-9be0eb4384de admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:06.255854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f097c-de1b-42cb-9734-9be0eb4384de admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:06.260444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc223c7-5dc5-478f-bb65-ee8faa1c099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:06.261102 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc223c7-5dc5-478f-bb65-ee8faa1c099c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:06.261389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc223c7-5dc5-478f-bb65-ee8faa1c099c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:06.261674 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc223c7-5dc5-478f-bb65-ee8faa1c099c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:06.262399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc223c7-5dc5-478f-bb65-ee8faa1c099c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:06.264049 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc223c7-5dc5-478f-bb65-ee8faa1c099c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:06.273933 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1333/2633] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:28:06.277808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e1fa3-5868-47ce-9791-4b6d888a0792 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:06.287615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e1fa3-5868-47ce-9791-4b6d888a0792 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:06.292244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a004-2f10-41ee-ae82-fd5c905e792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:06.293112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a004-2f10-41ee-ae82-fd5c905e792b admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:06.293394 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a004-2f10-41ee-ae82-fd5c905e792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:06.293670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a004-2f10-41ee-ae82-fd5c905e792b admin admin] PATH_INFO: `/v3/projects/95db574ff7d942149631c0f9a89228a3/users/d26187d738fa44bdac86d335433b5002/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:06.308467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a004-2f10-41ee-ae82-fd5c905e792b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95db574ff7d942149631c0f9a89228a3, user_id=d26187d738fa44bdac86d335433b5002, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:06.312022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a004-2f10-41ee-ae82-fd5c905e792b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:06.324409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1301/2634] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:06 2022] PUT /identity/v3/projects/95db574ff7d942149631c0f9a89228a3/users/d26187d738fa44bdac86d335433b5002/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:06.329182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444fbb-2efc-4552-b3bc-bd604ef38307 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:06.329477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444fbb-2efc-4552-b3bc-bd604ef38307 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:06.329763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df444fbb-2efc-4552-b3bc-bd604ef38307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:06.348230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-df444fbb-2efc-4552-b3bc-bd604ef38307 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:06.349634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-df444fbb-2efc-4552-b3bc-bd604ef38307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:06.407867 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1334/2635] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:06.417374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a004-2f10-41ee-ae82-fd5c905e792b admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:06.419059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-52b0a004-2f10-41ee-ae82-fd5c905e792b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:06.471417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:06.477438 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a004-2f10-41ee-ae82-fd5c905e792b admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:06.482103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a0108-bbff-4921-909e-f7f01017d375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:06.482795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a0108-bbff-4921-909e-f7f01017d375 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:06.483825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a0108-bbff-4921-909e-f7f01017d375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:06.484314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a0108-bbff-4921-909e-f7f01017d375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:06.493794 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a0108-bbff-4921-909e-f7f01017d375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:06.495209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a0108-bbff-4921-909e-f7f01017d375 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:06.504845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1302/2636] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:10.869233 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e2b7-6fb1-4802-be15-dc4229a26ce4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:10.869750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e2b7-6fb1-4802-be15-dc4229a26ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:10.869855 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0e2b7-6fb1-4802-be15-dc4229a26ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:10.914263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-36d0e2b7-6fb1-4802-be15-dc4229a26ce4 None None] MFA Rules not processed for user `d26187d738fa44bdac86d335433b5002`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:10.915703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-36d0e2b7-6fb1-4802-be15-dc4229a26ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:10.993978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1335/2637] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:10.998709 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a0108-bbff-4921-909e-f7f01017d375 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:11.009060 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a0108-bbff-4921-909e-f7f01017d375 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:11.014847 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8465ee-bac0-4e9a-af76-32e9d33d9741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:11.015624 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8465ee-bac0-4e9a-af76-32e9d33d9741 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:11.016087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8465ee-bac0-4e9a-af76-32e9d33d9741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:11.016518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8465ee-bac0-4e9a-af76-32e9d33d9741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:11.017513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8465ee-bac0-4e9a-af76-32e9d33d9741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:11.019640 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8465ee-bac0-4e9a-af76-32e9d33d9741 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:11.068992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1303/2638] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:10 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:28:11.072902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0e2b7-6fb1-4802-be15-dc4229a26ce4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:11.089646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0e2b7-6fb1-4802-be15-dc4229a26ce4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:11.132340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:11.177673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6042685-9b49-4e82-8626-233f7d30c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:11.178557 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6042685-9b49-4e82-8626-233f7d30c961 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:11.179585 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6042685-9b49-4e82-8626-233f7d30c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:11.180016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6042685-9b49-4e82-8626-233f7d30c961 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:11.180772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6042685-9b49-4e82-8626-233f7d30c961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:11.182876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6042685-9b49-4e82-8626-233f7d30c961 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:11.209604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1336/2639] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:11 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:11.213295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8465ee-bac0-4e9a-af76-32e9d33d9741 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:11.225469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8465ee-bac0-4e9a-af76-32e9d33d9741 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:11.230660 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d90e2-a4fc-4e79-a8ff-8812a83ace7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:11.231498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d90e2-a4fc-4e79-a8ff-8812a83ace7b admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:11.231895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d90e2-a4fc-4e79-a8ff-8812a83ace7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:11.232244 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d90e2-a4fc-4e79-a8ff-8812a83ace7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:11.233065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d90e2-a4fc-4e79-a8ff-8812a83ace7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:11.234764 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d90e2-a4fc-4e79-a8ff-8812a83ace7b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:11.249501 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1304/2640] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:11.253442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6042685-9b49-4e82-8626-233f7d30c961 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:11.265079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6042685-9b49-4e82-8626-233f7d30c961 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:11.270599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf6f87-6fe6-454f-bbec-26d5f34c3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:11.271649 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf6f87-6fe6-454f-bbec-26d5f34c3c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:11.272205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf6f87-6fe6-454f-bbec-26d5f34c3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:11.272205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf6f87-6fe6-454f-bbec-26d5f34c3c69 admin admin] PATH_INFO: `/v3/projects/0bcf025d700a4bc9ba3c95dcd881977f/users/c53926ad18434a1c87dc2fe350586059/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:11.288555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf6f87-6fe6-454f-bbec-26d5f34c3c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcf025d700a4bc9ba3c95dcd881977f, user_id=c53926ad18434a1c87dc2fe350586059, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:11.291263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf6f87-6fe6-454f-bbec-26d5f34c3c69 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:11.307154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1337/2641] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:11 2022] PUT /identity/v3/projects/0bcf025d700a4bc9ba3c95dcd881977f/users/c53926ad18434a1c87dc2fe350586059/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:11.311820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d90e2-a4fc-4e79-a8ff-8812a83ace7b admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:11.323089 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d90e2-a4fc-4e79-a8ff-8812a83ace7b admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:11.412177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e3427-c4d5-4b32-9c5e-89c5c2801dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:11.413529 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3427-c4d5-4b32-9c5e-89c5c2801dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:11.413878 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3427-c4d5-4b32-9c5e-89c5c2801dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:11.414223 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e3427-c4d5-4b32-9c5e-89c5c2801dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:11.415062 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e3427-c4d5-4b32-9c5e-89c5c2801dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:11.416726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e3427-c4d5-4b32-9c5e-89c5c2801dc9 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:11.429753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1305/2642] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:28:11.433969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf6f87-6fe6-454f-bbec-26d5f34c3c69 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:11.446825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf6f87-6fe6-454f-bbec-26d5f34c3c69 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:11.452330 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3be7d-5f03-484a-a37e-17d0b02ef92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:11.453463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3be7d-5f03-484a-a37e-17d0b02ef92e admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:11.453754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3be7d-5f03-484a-a37e-17d0b02ef92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:11.454031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3be7d-5f03-484a-a37e-17d0b02ef92e admin admin] PATH_INFO: `/v3/projects/0bcf025d700a4bc9ba3c95dcd881977f/users/c53926ad18434a1c87dc2fe350586059/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:11.456164 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3be7d-5f03-484a-a37e-17d0b02ef92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcf025d700a4bc9ba3c95dcd881977f, user_id=c53926ad18434a1c87dc2fe350586059, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:11.458891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3be7d-5f03-484a-a37e-17d0b02ef92e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:11.478201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1338/2643] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:11 2022] PUT /identity/v3/projects/0bcf025d700a4bc9ba3c95dcd881977f/users/c53926ad18434a1c87dc2fe350586059/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:16.676384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6769ec8-bd18-4af1-b164-92d873c87f97 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:16.676933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6769ec8-bd18-4af1-b164-92d873c87f97 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:16.676933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6769ec8-bd18-4af1-b164-92d873c87f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:16.714622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b6769ec8-bd18-4af1-b164-92d873c87f97 None None] MFA Rules not processed for user `c53926ad18434a1c87dc2fe350586059`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:16.716568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b6769ec8-bd18-4af1-b164-92d873c87f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:16.821125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1306/2644] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:16.835745 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3be7d-5f03-484a-a37e-17d0b02ef92e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:16.837579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6aa3be7d-5f03-484a-a37e-17d0b02ef92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:16.919177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6769ec8-bd18-4af1-b164-92d873c87f97 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:16.921817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b6769ec8-bd18-4af1-b164-92d873c87f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:16.958096 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3be7d-5f03-484a-a37e-17d0b02ef92e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:16.964782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab7aa-0c04-4f41-a312-6b4b3f69bf4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:16.966275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab7aa-0c04-4f41-a312-6b4b3f69bf4a service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:16.966767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab7aa-0c04-4f41-a312-6b4b3f69bf4a service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:16.967047 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab7aa-0c04-4f41-a312-6b4b3f69bf4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:16.979825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:16.996762 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6769ec8-bd18-4af1-b164-92d873c87f97 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:17.008910 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:17.009765 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:17.010125 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:17.010476 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:17.013602 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:17.040955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ab7aa-0c04-4f41-a312-6b4b3f69bf4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:17.043754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ab7aa-0c04-4f41-a312-6b4b3f69bf4a service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:17.067548 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1339/2645] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:17.093375 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:17.094914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:17.107174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1307/2646] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:18.810600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1d684-0719-4146-abfc-428d0f1be40d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:18.811479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1d684-0719-4146-abfc-428d0f1be40d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:18.811610 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1d684-0719-4146-abfc-428d0f1be40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:18.830865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c7b1d684-0719-4146-abfc-428d0f1be40d None None] MFA Rules not processed for user `d26187d738fa44bdac86d335433b5002`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:18.832180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c7b1d684-0719-4146-abfc-428d0f1be40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:18.839618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1340/2647] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:21.249128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:21.250713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:21.320650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1d684-0719-4146-abfc-428d0f1be40d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:21.323638 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c7b1d684-0719-4146-abfc-428d0f1be40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:21.345485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1d684-0719-4146-abfc-428d0f1be40d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:21.351236 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:21.352357 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:21.352707 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:21.353022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] PATH_INFO: `/v3/users/cabc5ecafe6d443c8459b8857a1e3242` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:21.354604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cabc5ecafe6d443c8459b8857a1e3242)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:21.358168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:21.364331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:21.368454 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027ebdf-012e-4128-8aa1-35347ccb2a0f service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:21.374083 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabddb0a-3314-46cd-8053-a4973c81ade7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:21.374748 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabddb0a-3314-46cd-8053-a4973c81ade7 service placement] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:21.375034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabddb0a-3314-46cd-8053-a4973c81ade7 service placement] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:21.375452 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabddb0a-3314-46cd-8053-a4973c81ade7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:21.377569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-dabddb0a-3314-46cd-8053-a4973c81ade7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:21.392384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabddb0a-3314-46cd-8053-a4973c81ade7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:21.394226 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabddb0a-3314-46cd-8053-a4973c81ade7 service placement] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:21.407513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1308/2648] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:21.423129 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cabc5ecafe6d443c8459b8857a1e3242'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.435364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cabc5ecafe6d443c8459b8857a1e3242'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.436373 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cabc5ecafe6d443c8459b8857a1e3242'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.444664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cabc5ecafe6d443c8459b8857a1e3242'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.460723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8301302-c01b-46e9-b9e5-4f2e5ad09a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cabc5ecafe6d443c8459b8857a1e3242'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.467477 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1341/2649] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:21 2022] DELETE /identity/v3/users/cabc5ecafe6d443c8459b8857a1e3242 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:21.671227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabddb0a-3314-46cd-8053-a4973c81ade7 service placement] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:21.688616 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabddb0a-3314-46cd-8053-a4973c81ade7 service placement] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:21.750098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:21.750964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:21.751245 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:21.751553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] PATH_INFO: `/v3/projects/4b24eaa8a053477b9debce1f6640e514` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:21.752733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b24eaa8a053477b9debce1f6640e514)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:21.754621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:21.780354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:21.825743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b24eaa8a053477b9debce1f6640e514', 'request_id': 'req-591c8e33-5f88-435f-b190-0e902b40b702'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.833753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b24eaa8a053477b9debce1f6640e514', 'request_id': 'req-591c8e33-5f88-435f-b190-0e902b40b702'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.845807 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b24eaa8a053477b9debce1f6640e514', 'request_id': 'req-591c8e33-5f88-435f-b190-0e902b40b702'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.858191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] The token cache is being invalidate because project 4b24eaa8a053477b9debce1f6640e514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:21.858545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.859268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-591c8e33-5f88-435f-b190-0e902b40b702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:21.861414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1309/2650] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:21 2022] DELETE /identity/v3/projects/4b24eaa8a053477b9debce1f6640e514 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:21.866121 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a7e05-7f37-4742-bd61-00f5566102c6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:21.866485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a7e05-7f37-4742-bd61-00f5566102c6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:21.866864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a7e05-7f37-4742-bd61-00f5566102c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:21.886868 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-886a7e05-7f37-4742-bd61-00f5566102c6 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:21.888288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-886a7e05-7f37-4742-bd61-00f5566102c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:21.981810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793f4f4-66e2-43dd-b3f4-7dbb2969cfcb None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:21.982084 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793f4f4-66e2-43dd-b3f4-7dbb2969cfcb None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:21.982403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793f4f4-66e2-43dd-b3f4-7dbb2969cfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:21.983508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1342/2651] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:22.004103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-0793f4f4-66e2-43dd-b3f4-7dbb2969cfcb None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:22.005340 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0793f4f4-66e2-43dd-b3f4-7dbb2969cfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:22.013603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1310/2652] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:22.017950 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a7e05-7f37-4742-bd61-00f5566102c6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:22.027924 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a7e05-7f37-4742-bd61-00f5566102c6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:22.032779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a861d-e104-4465-936c-1e7a06b6ced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:22.033494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a861d-e104-4465-936c-1e7a06b6ced4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:22.033780 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a861d-e104-4465-936c-1e7a06b6ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:22.034060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a861d-e104-4465-936c-1e7a06b6ced4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:22.034813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a861d-e104-4465-936c-1e7a06b6ced4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:28:22.035126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a861d-e104-4465-936c-1e7a06b6ced4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:22.036773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a861d-e104-4465-936c-1e7a06b6ced4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:22.050390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1343/2653] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:28:22.054451 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793f4f4-66e2-43dd-b3f4-7dbb2969cfcb None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:22.065319 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793f4f4-66e2-43dd-b3f4-7dbb2969cfcb None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:22.070277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb9dac-04e6-430e-811e-63fdb6488e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:22.071005 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb9dac-04e6-430e-811e-63fdb6488e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:22.071287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb9dac-04e6-430e-811e-63fdb6488e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:22.071614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb9dac-04e6-430e-811e-63fdb6488e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:22.072379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb9dac-04e6-430e-811e-63fdb6488e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:22.074357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb9dac-04e6-430e-811e-63fdb6488e18 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:22.106923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1311/2654] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:22 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:22.111669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a861d-e104-4465-936c-1e7a06b6ced4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:22.126433 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a861d-e104-4465-936c-1e7a06b6ced4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:22.202842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044f6e2-5548-425b-a6f0-cef1502f5fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:22.202842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044f6e2-5548-425b-a6f0-cef1502f5fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:22.202842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044f6e2-5548-425b-a6f0-cef1502f5fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:22.202842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044f6e2-5548-425b-a6f0-cef1502f5fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:22.203267 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044f6e2-5548-425b-a6f0-cef1502f5fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:22.203267 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044f6e2-5548-425b-a6f0-cef1502f5fb2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:22.235825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1344/2655] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:22 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:22.238230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb9dac-04e6-430e-811e-63fdb6488e18 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:22.249591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb9dac-04e6-430e-811e-63fdb6488e18 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:22.254632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d860b-d762-4c83-8884-80f4f3eefea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:22.255862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d860b-d762-4c83-8884-80f4f3eefea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:22.256201 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d860b-d762-4c83-8884-80f4f3eefea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:22.256546 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d860b-d762-4c83-8884-80f4f3eefea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:22.260983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d860b-d762-4c83-8884-80f4f3eefea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:22.263002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d860b-d762-4c83-8884-80f4f3eefea8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:22.274714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1312/2656] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:22.278935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044f6e2-5548-425b-a6f0-cef1502f5fb2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:22.285295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:22.291878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044f6e2-5548-425b-a6f0-cef1502f5fb2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:22.299020 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86e62-4c5d-4aa9-bf7a-2518d1d854c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:22.300524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86e62-4c5d-4aa9-bf7a-2518d1d854c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:22.301268 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86e62-4c5d-4aa9-bf7a-2518d1d854c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:22.301482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86e62-4c5d-4aa9-bf7a-2518d1d854c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:22.302606 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d86e62-4c5d-4aa9-bf7a-2518d1d854c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:22.304819 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d86e62-4c5d-4aa9-bf7a-2518d1d854c0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:22.318673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1345/2657] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:22.323141 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d860b-d762-4c83-8884-80f4f3eefea8 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:22.334859 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d860b-d762-4c83-8884-80f4f3eefea8 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:22.339726 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0589e7d-122d-4a91-8c12-db2dfd99bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:22.341169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0589e7d-122d-4a91-8c12-db2dfd99bec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:22.341458 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0589e7d-122d-4a91-8c12-db2dfd99bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:22.341731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0589e7d-122d-4a91-8c12-db2dfd99bec8 admin admin] PATH_INFO: `/v3/projects/a24179218e9d4010826604752a7edf85/users/7096fffbcf88404d81d57f98a2b6f129/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:22.366393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0589e7d-122d-4a91-8c12-db2dfd99bec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24179218e9d4010826604752a7edf85, user_id=7096fffbcf88404d81d57f98a2b6f129, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:22.372351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0589e7d-122d-4a91-8c12-db2dfd99bec8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:22.395519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1313/2658] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:22 2022] PUT /identity/v3/projects/a24179218e9d4010826604752a7edf85/users/7096fffbcf88404d81d57f98a2b6f129/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:22.407107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879457fb-db38-411f-a126-a54c76b27a0e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:22.407642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879457fb-db38-411f-a126-a54c76b27a0e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:22.407886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879457fb-db38-411f-a126-a54c76b27a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:22.439068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-879457fb-db38-411f-a126-a54c76b27a0e None None] MFA Rules not processed for user `7096fffbcf88404d81d57f98a2b6f129`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:22.440389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-879457fb-db38-411f-a126-a54c76b27a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:22.510944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1346/2659] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:22.529564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0589e7d-122d-4a91-8c12-db2dfd99bec8 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:22.529564 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-c0589e7d-122d-4a91-8c12-db2dfd99bec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:22.597480 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0589e7d-122d-4a91-8c12-db2dfd99bec8 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:22.601267 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d977d4-9db1-41ca-a021-ed59dc263bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:22.602123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d977d4-9db1-41ca-a021-ed59dc263bfc service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:22.602247 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d977d4-9db1-41ca-a021-ed59dc263bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:22.602454 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d977d4-9db1-41ca-a021-ed59dc263bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:22.612146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d977d4-9db1-41ca-a021-ed59dc263bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:22.613606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d977d4-9db1-41ca-a021-ed59dc263bfc service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:22.623189 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1314/2660] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:27.907544 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879457fb-db38-411f-a126-a54c76b27a0e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:27.908975 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-879457fb-db38-411f-a126-a54c76b27a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:27.981066 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879457fb-db38-411f-a126-a54c76b27a0e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:27.985729 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:27.986621 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:27.986903 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:27.987179 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] PATH_INFO: `/v3/users/cf874af0cff148818160493ed3751678` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:27.988555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf874af0cff148818160493ed3751678)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:27.990590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:28.035995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf874af0cff148818160493ed3751678'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.045280 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf874af0cff148818160493ed3751678'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.045954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf874af0cff148818160493ed3751678'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.053535 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf874af0cff148818160493ed3751678'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.066784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf874af0cff148818160493ed3751678'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.069180 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:28.074193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1347/2661] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:27 2022] DELETE /identity/v3/users/cf874af0cff148818160493ed3751678 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:28.079182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752d08-b1ac-4e09-8f23-07b8b719d0d6 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:28.079718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752d08-b1ac-4e09-8f23-07b8b719d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:28.079930 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752d08-b1ac-4e09-8f23-07b8b719d0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:28.097214 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-73752d08-b1ac-4e09-8f23-07b8b719d0d6 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:28.098460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-73752d08-b1ac-4e09-8f23-07b8b719d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:28.151695 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:28.174009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1315/2662] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:28.184484 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:28.186608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:28.243970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992d7e0-ab81-4964-96af-f802d9f552e1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:28.247662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fb7f9-9d78-4aa0-81dd-63d98d456895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:28.248311 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fb7f9-9d78-4aa0-81dd-63d98d456895 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:28.248596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fb7f9-9d78-4aa0-81dd-63d98d456895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:28.248879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fb7f9-9d78-4aa0-81dd-63d98d456895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:28.257940 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fb7f9-9d78-4aa0-81dd-63d98d456895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:28.259387 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fb7f9-9d78-4aa0-81dd-63d98d456895 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:28.268955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1348/2663] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:28.556617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752d08-b1ac-4e09-8f23-07b8b719d0d6 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:28.558116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-73752d08-b1ac-4e09-8f23-07b8b719d0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:28.573013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752d08-b1ac-4e09-8f23-07b8b719d0d6 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:28.578356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:28.579447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:28.580096 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:28.580442 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] PATH_INFO: `/v3/projects/975ed3f17ee54554892092ec70986e3a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:28.581791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975ed3f17ee54554892092ec70986e3a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:28.583923 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:28.630708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975ed3f17ee54554892092ec70986e3a', 'request_id': 'req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.637286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975ed3f17ee54554892092ec70986e3a', 'request_id': 'req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.644272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975ed3f17ee54554892092ec70986e3a', 'request_id': 'req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.655603 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] The token cache is being invalidate because project 975ed3f17ee54554892092ec70986e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:28.655891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.656517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.658136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1316/2664] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:28 2022] DELETE /identity/v3/projects/975ed3f17ee54554892092ec70986e3a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:28.662142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fb7f9-9d78-4aa0-81dd-63d98d456895 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:28.671963 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fb7f9-9d78-4aa0-81dd-63d98d456895 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:28.728981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:28.730016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:28.730307 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:28.730582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] PATH_INFO: `/v3/users/10ea4fcb80e9428a8cd06a8ed44ee2c5` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:28.731845 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ea4fcb80e9428a8cd06a8ed44ee2c5)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:28.734149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:28.787482 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ea4fcb80e9428a8cd06a8ed44ee2c5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.794340 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ea4fcb80e9428a8cd06a8ed44ee2c5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.795000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ea4fcb80e9428a8cd06a8ed44ee2c5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.802112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ea4fcb80e9428a8cd06a8ed44ee2c5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.814021 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c400d1b5-1f1d-4f54-a310-7f2ba3961acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ea4fcb80e9428a8cd06a8ed44ee2c5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:28.819898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1349/2665] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:28 2022] DELETE /identity/v3/users/10ea4fcb80e9428a8cd06a8ed44ee2c5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:29.101149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:29.104088 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:29.117148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d6c5d-9cf3-487d-9fc8-e28fca225a17 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:29.175645 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:29.176482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.176791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.177114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] PATH_INFO: `/v3/projects/21414264608648aeb0caf53a2af5360a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.178306 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21414264608648aeb0caf53a2af5360a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:29.180253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:29.227891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21414264608648aeb0caf53a2af5360a', 'request_id': 'req-c63e26e4-7a9a-4c33-ae57-ef1771603030'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:29.234400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21414264608648aeb0caf53a2af5360a', 'request_id': 'req-c63e26e4-7a9a-4c33-ae57-ef1771603030'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:29.241317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21414264608648aeb0caf53a2af5360a', 'request_id': 'req-c63e26e4-7a9a-4c33-ae57-ef1771603030'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:29.248882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:29.252805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] The token cache is being invalidate because project 21414264608648aeb0caf53a2af5360a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:29.253282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:29.253974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-c63e26e4-7a9a-4c33-ae57-ef1771603030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:29.256099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1317/2666] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:29 2022] DELETE /identity/v3/projects/21414264608648aeb0caf53a2af5360a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:29.261159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d62c-bd43-48d8-a32a-2b4bee592cc8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.261699 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d62c-bd43-48d8-a32a-2b4bee592cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.262776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d62c-bd43-48d8-a32a-2b4bee592cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.280370 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-01d2d62c-bd43-48d8-a32a-2b4bee592cc8 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:29.281603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-01d2d62c-bd43-48d8-a32a-2b4bee592cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:29.299416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:29.343635 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1350/2667] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:29.352368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef4cef-886e-47d7-a39e-9e77c5ecb381 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.352663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef4cef-886e-47d7-a39e-9e77c5ecb381 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.352945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef4cef-886e-47d7-a39e-9e77c5ecb381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.372396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-ffef4cef-886e-47d7-a39e-9e77c5ecb381 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:29.373591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ffef4cef-886e-47d7-a39e-9e77c5ecb381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:29.381478 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1318/2668] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:29.385825 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2d62c-bd43-48d8-a32a-2b4bee592cc8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:29.395500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2d62c-bd43-48d8-a32a-2b4bee592cc8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:29.400184 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d27b-f1e2-4d3d-89fa-a869adcd5c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:29.400873 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d27b-f1e2-4d3d-89fa-a869adcd5c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.401142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d27b-f1e2-4d3d-89fa-a869adcd5c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.401416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d27b-f1e2-4d3d-89fa-a869adcd5c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.402149 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d27b-f1e2-4d3d-89fa-a869adcd5c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:28:29.402463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d27b-f1e2-4d3d-89fa-a869adcd5c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:29.404089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d27b-f1e2-4d3d-89fa-a869adcd5c0a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:29.415781 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1351/2669] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:28:29.420484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef4cef-886e-47d7-a39e-9e77c5ecb381 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:29.429707 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef4cef-886e-47d7-a39e-9e77c5ecb381 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:29.435209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1f73-596e-4fdc-ac1a-d381ff521a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:29.436134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1f73-596e-4fdc-ac1a-d381ff521a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.436530 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1f73-596e-4fdc-ac1a-d381ff521a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.436802 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1f73-596e-4fdc-ac1a-d381ff521a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.437493 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d1f73-596e-4fdc-ac1a-d381ff521a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:29.439797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d1f73-596e-4fdc-ac1a-d381ff521a05 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:29.468424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1319/2670] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:29 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:29.473009 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d27b-f1e2-4d3d-89fa-a869adcd5c0a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:29.484159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d27b-f1e2-4d3d-89fa-a869adcd5c0a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:29.539457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22091b-f12a-47c3-afeb-0fb708104dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:29.540132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22091b-f12a-47c3-afeb-0fb708104dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.540417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22091b-f12a-47c3-afeb-0fb708104dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.540696 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22091b-f12a-47c3-afeb-0fb708104dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.541378 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22091b-f12a-47c3-afeb-0fb708104dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:29.543840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22091b-f12a-47c3-afeb-0fb708104dc6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:29.564077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1352/2671] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:29 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:29.568227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1f73-596e-4fdc-ac1a-d381ff521a05 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:29.578373 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1f73-596e-4fdc-ac1a-d381ff521a05 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:29.583167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557aab9-5d9f-4058-aba9-90c535f754f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:29.583867 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557aab9-5d9f-4058-aba9-90c535f754f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.584149 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557aab9-5d9f-4058-aba9-90c535f754f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.584424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557aab9-5d9f-4058-aba9-90c535f754f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.586104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557aab9-5d9f-4058-aba9-90c535f754f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:29.587717 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4557aab9-5d9f-4058-aba9-90c535f754f6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:29.597796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1320/2672] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:29.601590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22091b-f12a-47c3-afeb-0fb708104dc6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:29.612039 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22091b-f12a-47c3-afeb-0fb708104dc6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:29.616633 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bc8c0-8caa-495f-a55d-82935834d206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:29.617284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bc8c0-8caa-495f-a55d-82935834d206 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.617570 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bc8c0-8caa-495f-a55d-82935834d206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.617847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bc8c0-8caa-495f-a55d-82935834d206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.618574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bc8c0-8caa-495f-a55d-82935834d206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:29.620182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bc8c0-8caa-495f-a55d-82935834d206 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:29.630462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1353/2673] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:29.634290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557aab9-5d9f-4058-aba9-90c535f754f6 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:29.644119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4557aab9-5d9f-4058-aba9-90c535f754f6 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:29.648583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aee6a-bd02-44cc-8f7f-c573f19b460a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:29.649444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aee6a-bd02-44cc-8f7f-c573f19b460a admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.649722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aee6a-bd02-44cc-8f7f-c573f19b460a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.649992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aee6a-bd02-44cc-8f7f-c573f19b460a admin admin] PATH_INFO: `/v3/projects/175e67b46fe34e3eba778f28dd3322b1/users/46049becd0c9464ba13d103c5ec9bc4d/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.664163 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aee6a-bd02-44cc-8f7f-c573f19b460a admin admin] RBAC: Authorizing `identity:create_grant(project_id=175e67b46fe34e3eba778f28dd3322b1, user_id=46049becd0c9464ba13d103c5ec9bc4d, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:29.666746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aee6a-bd02-44cc-8f7f-c573f19b460a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:29.680555 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1321/2674] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:29 2022] PUT /identity/v3/projects/175e67b46fe34e3eba778f28dd3322b1/users/46049becd0c9464ba13d103c5ec9bc4d/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:29.691489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa84ba-f4c9-4fdd-ac7b-1fdddd2aeef6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.691788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa84ba-f4c9-4fdd-ac7b-1fdddd2aeef6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.692074 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa84ba-f4c9-4fdd-ac7b-1fdddd2aeef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.718858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a4fa84ba-f4c9-4fdd-ac7b-1fdddd2aeef6 None None] MFA Rules not processed for user `46049becd0c9464ba13d103c5ec9bc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:29.720084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a4fa84ba-f4c9-4fdd-ac7b-1fdddd2aeef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:29.788152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1354/2675] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:29.792598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aee6a-bd02-44cc-8f7f-c573f19b460a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:29.855305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aee6a-bd02-44cc-8f7f-c573f19b460a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:29.860550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30743c09-758f-474f-841c-8f5aa24c112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:29.861210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30743c09-758f-474f-841c-8f5aa24c112b admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.861499 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30743c09-758f-474f-841c-8f5aa24c112b admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.861780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30743c09-758f-474f-841c-8f5aa24c112b admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.862472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30743c09-758f-474f-841c-8f5aa24c112b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:29.864411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30743c09-758f-474f-841c-8f5aa24c112b admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:29.888854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1322/2676] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:29 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:29.892971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa84ba-f4c9-4fdd-ac7b-1fdddd2aeef6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:29.904302 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa84ba-f4c9-4fdd-ac7b-1fdddd2aeef6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:29.916354 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:29.965500 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7410d9-717e-4c4f-b53e-aa702903a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:29.966203 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7410d9-717e-4c4f-b53e-aa702903a574 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:29.966485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7410d9-717e-4c4f-b53e-aa702903a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:29.966764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7410d9-717e-4c4f-b53e-aa702903a574 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:29.967724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7410d9-717e-4c4f-b53e-aa702903a574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:29.969627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7410d9-717e-4c4f-b53e-aa702903a574 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:29.990658 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1355/2677] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:29 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:29.994613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30743c09-758f-474f-841c-8f5aa24c112b admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:30.005070 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30743c09-758f-474f-841c-8f5aa24c112b admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:30.009693 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69268fd9-6df5-4fb7-94b3-9bcadb538ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:30.010354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268fd9-6df5-4fb7-94b3-9bcadb538ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:30.010637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268fd9-6df5-4fb7-94b3-9bcadb538ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:30.010913 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69268fd9-6df5-4fb7-94b3-9bcadb538ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:30.011689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69268fd9-6df5-4fb7-94b3-9bcadb538ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:30.013276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69268fd9-6df5-4fb7-94b3-9bcadb538ae8 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:30.024158 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1323/2678] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:30.028861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7410d9-717e-4c4f-b53e-aa702903a574 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:30.039964 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7410d9-717e-4c4f-b53e-aa702903a574 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:30.045851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a10de2-4cb7-4df5-acf8-713ef45e0076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:30.046757 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a10de2-4cb7-4df5-acf8-713ef45e0076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:30.047042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a10de2-4cb7-4df5-acf8-713ef45e0076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:30.047321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a10de2-4cb7-4df5-acf8-713ef45e0076 admin admin] PATH_INFO: `/v3/projects/470337ddfbe0466cb061f6742c2bfba7/users/940f460c652e4de29bfe821605ce7093/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:30.064352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a10de2-4cb7-4df5-acf8-713ef45e0076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470337ddfbe0466cb061f6742c2bfba7, user_id=940f460c652e4de29bfe821605ce7093, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:30.067067 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a10de2-4cb7-4df5-acf8-713ef45e0076 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:30.081467 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1356/2679] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:30 2022] PUT /identity/v3/projects/470337ddfbe0466cb061f6742c2bfba7/users/940f460c652e4de29bfe821605ce7093/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:30.085647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69268fd9-6df5-4fb7-94b3-9bcadb538ae8 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:30.096205 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69268fd9-6df5-4fb7-94b3-9bcadb538ae8 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:30.153806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fc975-04a9-422d-bf9c-7ad7cdd34635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:30.154486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc975-04a9-422d-bf9c-7ad7cdd34635 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:30.154772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc975-04a9-422d-bf9c-7ad7cdd34635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:30.155050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fc975-04a9-422d-bf9c-7ad7cdd34635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:30.155842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc975-04a9-422d-bf9c-7ad7cdd34635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:30.157439 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fc975-04a9-422d-bf9c-7ad7cdd34635 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:30.167743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1324/2680] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:30.172326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a10de2-4cb7-4df5-acf8-713ef45e0076 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:30.183680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a10de2-4cb7-4df5-acf8-713ef45e0076 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:30.189829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f5d7-f9b5-432c-9f53-cf2b4d19bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:30.190872 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f5d7-f9b5-432c-9f53-cf2b4d19bb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:30.191168 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f5d7-f9b5-432c-9f53-cf2b4d19bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:30.191497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f5d7-f9b5-432c-9f53-cf2b4d19bb84 admin admin] PATH_INFO: `/v3/projects/470337ddfbe0466cb061f6742c2bfba7/users/940f460c652e4de29bfe821605ce7093/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:30.193613 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f5d7-f9b5-432c-9f53-cf2b4d19bb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470337ddfbe0466cb061f6742c2bfba7, user_id=940f460c652e4de29bfe821605ce7093, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:30.196718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f5d7-f9b5-432c-9f53-cf2b4d19bb84 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:30.208728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1357/2681] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:30 2022] PUT /identity/v3/projects/470337ddfbe0466cb061f6742c2bfba7/users/940f460c652e4de29bfe821605ce7093/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:30.221480 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fddb5e-a8b4-4eac-a116-282de7bd5ed6 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:30.221716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fddb5e-a8b4-4eac-a116-282de7bd5ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:30.222111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fddb5e-a8b4-4eac-a116-282de7bd5ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:30.235179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:30.250583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-d3fddb5e-a8b4-4eac-a116-282de7bd5ed6 None None] MFA Rules not processed for user `940f460c652e4de29bfe821605ce7093`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:30.251837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d3fddb5e-a8b4-4eac-a116-282de7bd5ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:30.320447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1325/2682] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:30.331647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f5d7-f9b5-432c-9f53-cf2b4d19bb84 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:30.333358 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3506f5d7-f9b5-432c-9f53-cf2b4d19bb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:30.396611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f5d7-f9b5-432c-9f53-cf2b4d19bb84 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:30.400317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee24b5-9540-4d16-bda3-168de85f141e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:30.400959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee24b5-9540-4d16-bda3-168de85f141e service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:30.401242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee24b5-9540-4d16-bda3-168de85f141e service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:30.401516 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee24b5-9540-4d16-bda3-168de85f141e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:30.461756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee24b5-9540-4d16-bda3-168de85f141e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:30.464615 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee24b5-9540-4d16-bda3-168de85f141e service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:30.482739 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1358/2683] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:31.263254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fddb5e-a8b4-4eac-a116-282de7bd5ed6 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:31.264672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d3fddb5e-a8b4-4eac-a116-282de7bd5ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:31.327742 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fddb5e-a8b4-4eac-a116-282de7bd5ed6 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:31.332388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:31.333256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:31.333537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:31.333812 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] PATH_INFO: `/v3/users/7096fffbcf88404d81d57f98a2b6f129` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:31.334987 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7096fffbcf88404d81d57f98a2b6f129)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:31.336921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:31.385601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7096fffbcf88404d81d57f98a2b6f129'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:31.386264 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7096fffbcf88404d81d57f98a2b6f129'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:31.393104 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7096fffbcf88404d81d57f98a2b6f129'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:31.393731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7096fffbcf88404d81d57f98a2b6f129'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:31.400999 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7096fffbcf88404d81d57f98a2b6f129'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:31.419161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1326/2684] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:31 2022] DELETE /identity/v3/users/7096fffbcf88404d81d57f98a2b6f129 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:31.423598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ea37f-32a1-45a4-8a23-176f1ef14255 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:31.424026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ea37f-32a1-45a4-8a23-176f1ef14255 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:31.424165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ea37f-32a1-45a4-8a23-176f1ef14255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:31.442934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f11ea37f-32a1-45a4-8a23-176f1ef14255 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:31.444178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f11ea37f-32a1-45a4-8a23-176f1ef14255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:31.462703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:31.514622 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1359/2685] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:31.524443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:31.525826 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:31.539796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:31.584563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264bb31-497d-4785-ae38-4fea54b5c708 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:31.588194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe880555-c13f-48dc-b00d-fbaa97a41780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:31.588834 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe880555-c13f-48dc-b00d-fbaa97a41780 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:31.589112 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe880555-c13f-48dc-b00d-fbaa97a41780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:31.589414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe880555-c13f-48dc-b00d-fbaa97a41780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:31.599240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe880555-c13f-48dc-b00d-fbaa97a41780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:31.600701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe880555-c13f-48dc-b00d-fbaa97a41780 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:31.610136 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1327/2686] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:31.889442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ea37f-32a1-45a4-8a23-176f1ef14255 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:31.890866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f11ea37f-32a1-45a4-8a23-176f1ef14255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:31.905059 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ea37f-32a1-45a4-8a23-176f1ef14255 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:31.911035 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:31.912070 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:31.912449 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:31.912821 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] PATH_INFO: `/v3/projects/a24179218e9d4010826604752a7edf85` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:31.915116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24179218e9d4010826604752a7edf85)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:31.918687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:31.971590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24179218e9d4010826604752a7edf85', 'request_id': 'req-f0f02375-11ac-4cdb-9793-56b0a93c0d91'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:31.983720 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24179218e9d4010826604752a7edf85', 'request_id': 'req-f0f02375-11ac-4cdb-9793-56b0a93c0d91'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:32.002212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24179218e9d4010826604752a7edf85', 'request_id': 'req-f0f02375-11ac-4cdb-9793-56b0a93c0d91'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:32.014332 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] The token cache is being invalidate because project a24179218e9d4010826604752a7edf85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:32.014625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:32.015316 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-f0f02375-11ac-4cdb-9793-56b0a93c0d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:32.016894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1360/2687] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:31 2022] DELETE /identity/v3/projects/a24179218e9d4010826604752a7edf85 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:32.021604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4e9a6-aa78-4fa5-94b1-435131ce04c0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.021894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4e9a6-aa78-4fa5-94b1-435131ce04c0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.022173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4e9a6-aa78-4fa5-94b1-435131ce04c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.041002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-5db4e9a6-aa78-4fa5-94b1-435131ce04c0 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:32.042209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-5db4e9a6-aa78-4fa5-94b1-435131ce04c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:32.108600 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1328/2688] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:32.118026 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05ad8-e5dc-4fc9-9ece-febce90cd6ba None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.118422 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05ad8-e5dc-4fc9-9ece-febce90cd6ba None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.118764 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e05ad8-e5dc-4fc9-9ece-febce90cd6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.138653 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-93e05ad8-e5dc-4fc9-9ece-febce90cd6ba None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:32.139952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-93e05ad8-e5dc-4fc9-9ece-febce90cd6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:32.148016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1361/2689] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:32.152225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4e9a6-aa78-4fa5-94b1-435131ce04c0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.162066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4e9a6-aa78-4fa5-94b1-435131ce04c0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.166800 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56d4a-9a7b-4b00-9784-da2d3a7e7aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.167515 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56d4a-9a7b-4b00-9784-da2d3a7e7aee admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.167960 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56d4a-9a7b-4b00-9784-da2d3a7e7aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.168279 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56d4a-9a7b-4b00-9784-da2d3a7e7aee admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.169008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56d4a-9a7b-4b00-9784-da2d3a7e7aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:28:32.169314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56d4a-9a7b-4b00-9784-da2d3a7e7aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.170925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56d4a-9a7b-4b00-9784-da2d3a7e7aee admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.182585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1329/2690] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:28:32.187612 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05ad8-e5dc-4fc9-9ece-febce90cd6ba None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.196915 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e05ad8-e5dc-4fc9-9ece-febce90cd6ba None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.202248 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eea25-f9e5-4c5e-b384-000b58b296fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.202904 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eea25-f9e5-4c5e-b384-000b58b296fd admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.203190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eea25-f9e5-4c5e-b384-000b58b296fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.203511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eea25-f9e5-4c5e-b384-000b58b296fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.204200 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eea25-f9e5-4c5e-b384-000b58b296fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.206073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eea25-f9e5-4c5e-b384-000b58b296fd admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.231068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1362/2691] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:32 2022] POST /identity/v3/projects => generated 357 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:32.235183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56d4a-9a7b-4b00-9784-da2d3a7e7aee admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.245058 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56d4a-9a7b-4b00-9784-da2d3a7e7aee admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.300672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28623d-2885-40d3-835d-8dee46ebe235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.301272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28623d-2885-40d3-835d-8dee46ebe235 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.301545 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28623d-2885-40d3-835d-8dee46ebe235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.301820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28623d-2885-40d3-835d-8dee46ebe235 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.302514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28623d-2885-40d3-835d-8dee46ebe235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.304531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28623d-2885-40d3-835d-8dee46ebe235 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.324103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1330/2692] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:32 2022] POST /identity/v3/users => generated 279 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:32.328680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eea25-f9e5-4c5e-b384-000b58b296fd admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.338811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eea25-f9e5-4c5e-b384-000b58b296fd admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.343392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633c69a-a0df-472c-a071-74710c936948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.344046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633c69a-a0df-472c-a071-74710c936948 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.344329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633c69a-a0df-472c-a071-74710c936948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.344604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633c69a-a0df-472c-a071-74710c936948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.345326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633c69a-a0df-472c-a071-74710c936948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.346959 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633c69a-a0df-472c-a071-74710c936948 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.357750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1363/2693] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:32.361921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28623d-2885-40d3-835d-8dee46ebe235 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.372475 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28623d-2885-40d3-835d-8dee46ebe235 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.377117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5e0fe-55a1-411c-a6ca-4e383e458376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.377796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5e0fe-55a1-411c-a6ca-4e383e458376 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.378080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5e0fe-55a1-411c-a6ca-4e383e458376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.378354 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5e0fe-55a1-411c-a6ca-4e383e458376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.379081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5e0fe-55a1-411c-a6ca-4e383e458376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.380691 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5e0fe-55a1-411c-a6ca-4e383e458376 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.390504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1331/2694] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:32.394543 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633c69a-a0df-472c-a071-74710c936948 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.404406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633c69a-a0df-472c-a071-74710c936948 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.409312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893f2dd-e5a7-4c3c-9dd7-8dae9f8ad260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.410230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893f2dd-e5a7-4c3c-9dd7-8dae9f8ad260 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.410515 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893f2dd-e5a7-4c3c-9dd7-8dae9f8ad260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.410842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893f2dd-e5a7-4c3c-9dd7-8dae9f8ad260 admin admin] PATH_INFO: `/v3/projects/148db0164a6d4cdd99fe7a04aef7f082/users/599ba2d575aa4e1f92599cfcccb2d6ea/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.427002 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893f2dd-e5a7-4c3c-9dd7-8dae9f8ad260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148db0164a6d4cdd99fe7a04aef7f082, user_id=599ba2d575aa4e1f92599cfcccb2d6ea, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.429695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893f2dd-e5a7-4c3c-9dd7-8dae9f8ad260 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.443150 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1364/2695] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:32 2022] PUT /identity/v3/projects/148db0164a6d4cdd99fe7a04aef7f082/users/599ba2d575aa4e1f92599cfcccb2d6ea/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:32.453594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b144a2-931a-4d36-849c-dad53647dfb2 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.453891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b144a2-931a-4d36-849c-dad53647dfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.454176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b144a2-931a-4d36-849c-dad53647dfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.480029 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-25b144a2-931a-4d36-849c-dad53647dfb2 None None] MFA Rules not processed for user `599ba2d575aa4e1f92599cfcccb2d6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:32.481768 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-25b144a2-931a-4d36-849c-dad53647dfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:32.490947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:32.547239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1332/2696] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:32 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:32.551893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893f2dd-e5a7-4c3c-9dd7-8dae9f8ad260 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.596382 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:32.614132 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893f2dd-e5a7-4c3c-9dd7-8dae9f8ad260 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.618864 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac4fba-038c-4fa6-a3b1-0fc8a3a1dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.619550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac4fba-038c-4fa6-a3b1-0fc8a3a1dde1 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.619866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac4fba-038c-4fa6-a3b1-0fc8a3a1dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.620145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac4fba-038c-4fa6-a3b1-0fc8a3a1dde1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.620890 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac4fba-038c-4fa6-a3b1-0fc8a3a1dde1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.623260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac4fba-038c-4fa6-a3b1-0fc8a3a1dde1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.647423 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1365/2697] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:32 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:28:32.651479 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b144a2-931a-4d36-849c-dad53647dfb2 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.662191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b144a2-931a-4d36-849c-dad53647dfb2 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.717817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438e31c-1928-46e6-aa3d-93397ece8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.718519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438e31c-1928-46e6-aa3d-93397ece8ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.718808 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438e31c-1928-46e6-aa3d-93397ece8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.719085 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438e31c-1928-46e6-aa3d-93397ece8ca1 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.719842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438e31c-1928-46e6-aa3d-93397ece8ca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.721823 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438e31c-1928-46e6-aa3d-93397ece8ca1 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.741473 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1333/2698] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:32 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:32.745705 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac4fba-038c-4fa6-a3b1-0fc8a3a1dde1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.755809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac4fba-038c-4fa6-a3b1-0fc8a3a1dde1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.760391 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f62fcc-08f9-4b02-9cb5-db0b4a3096f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.761043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f62fcc-08f9-4b02-9cb5-db0b4a3096f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.761327 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f62fcc-08f9-4b02-9cb5-db0b4a3096f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.761599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f62fcc-08f9-4b02-9cb5-db0b4a3096f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.762321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f62fcc-08f9-4b02-9cb5-db0b4a3096f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.763921 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f62fcc-08f9-4b02-9cb5-db0b4a3096f7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.774755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1366/2699] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:28:32.779197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438e31c-1928-46e6-aa3d-93397ece8ca1 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.788990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438e31c-1928-46e6-aa3d-93397ece8ca1 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.794212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924294f9-809c-4d64-822a-bf27cfc45563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.795077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924294f9-809c-4d64-822a-bf27cfc45563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.795390 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924294f9-809c-4d64-822a-bf27cfc45563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.795668 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924294f9-809c-4d64-822a-bf27cfc45563 admin admin] PATH_INFO: `/v3/projects/b023f9b41005477688779f13675c9df0/users/8aab2010b02445c48df68a424ff27a66/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.810240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924294f9-809c-4d64-822a-bf27cfc45563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b023f9b41005477688779f13675c9df0, user_id=8aab2010b02445c48df68a424ff27a66, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.813109 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924294f9-809c-4d64-822a-bf27cfc45563 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.825845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1334/2700] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:32 2022] PUT /identity/v3/projects/b023f9b41005477688779f13675c9df0/users/8aab2010b02445c48df68a424ff27a66/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:32.830086 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f62fcc-08f9-4b02-9cb5-db0b4a3096f7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.840608 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f62fcc-08f9-4b02-9cb5-db0b4a3096f7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.898718 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a7a25-34c9-4a09-a69e-0f7834729156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.899418 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7a25-34c9-4a09-a69e-0f7834729156 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.899705 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7a25-34c9-4a09-a69e-0f7834729156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.899982 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7a25-34c9-4a09-a69e-0f7834729156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.900707 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a7a25-34c9-4a09-a69e-0f7834729156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.902801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a7a25-34c9-4a09-a69e-0f7834729156 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.912526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1367/2701] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:28:32.916944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924294f9-809c-4d64-822a-bf27cfc45563 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:32.927632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924294f9-809c-4d64-822a-bf27cfc45563 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:32.932227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495ba3-c2f5-4a08-a666-000aa39d46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:32.933101 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495ba3-c2f5-4a08-a666-000aa39d46f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.933411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495ba3-c2f5-4a08-a666-000aa39d46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.933683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6495ba3-c2f5-4a08-a666-000aa39d46f2 admin admin] PATH_INFO: `/v3/projects/b023f9b41005477688779f13675c9df0/users/8aab2010b02445c48df68a424ff27a66/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.935942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495ba3-c2f5-4a08-a666-000aa39d46f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b023f9b41005477688779f13675c9df0, user_id=8aab2010b02445c48df68a424ff27a66, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:32.938540 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6495ba3-c2f5-4a08-a666-000aa39d46f2 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:32.948670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1335/2702] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:32 2022] PUT /identity/v3/projects/b023f9b41005477688779f13675c9df0/users/8aab2010b02445c48df68a424ff27a66/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:32.959065 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6a08-cd3f-49a7-8c06-a02a57280d12 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:32.959479 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6a08-cd3f-49a7-8c06-a02a57280d12 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:32.959971 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6a08-cd3f-49a7-8c06-a02a57280d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:32.988880 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c86c6a08-cd3f-49a7-8c06-a02a57280d12 None None] MFA Rules not processed for user `8aab2010b02445c48df68a424ff27a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:32.990090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c86c6a08-cd3f-49a7-8c06-a02a57280d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:33.034663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495ba3-c2f5-4a08-a666-000aa39d46f2 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:33.036411 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b6495ba3-c2f5-4a08-a666-000aa39d46f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:33.057511 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1368/2703] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:32 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:33.068859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c6a08-cd3f-49a7-8c06-a02a57280d12 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:33.070209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c86c6a08-cd3f-49a7-8c06-a02a57280d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:33.101152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6495ba3-c2f5-4a08-a666-000aa39d46f2 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:33.105218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:33.105875 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:33.106155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:33.106429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:33.108888 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:33.116354 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:33.123398 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:33.132785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c6a08-cd3f-49a7-8c06-a02a57280d12 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:33.136998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43195a-46e3-4eb8-bc69-84c24b1d3de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:33.137646 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43195a-46e3-4eb8-bc69-84c24b1d3de8 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:33.137934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43195a-46e3-4eb8-bc69-84c24b1d3de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:33.138212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43195a-46e3-4eb8-bc69-84c24b1d3de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:33.147481 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43195a-46e3-4eb8-bc69-84c24b1d3de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:33.148912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43195a-46e3-4eb8-bc69-84c24b1d3de8 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:33.159124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1369/2704] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:33 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:28:33.175535 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:33.176993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:33.187173 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1336/2705] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:33.269835 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43195a-46e3-4eb8-bc69-84c24b1d3de8 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:33.280155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43195a-46e3-4eb8-bc69-84c24b1d3de8 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:33.284016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b46e2f-50c8-4128-9873-c6019909b825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:33.284791 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b46e2f-50c8-4128-9873-c6019909b825 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:33.285146 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b46e2f-50c8-4128-9873-c6019909b825 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:33.285426 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b46e2f-50c8-4128-9873-c6019909b825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:33.352451 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b46e2f-50c8-4128-9873-c6019909b825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:33.355602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b46e2f-50c8-4128-9873-c6019909b825 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:33.367579 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1370/2706] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:33 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:36.683936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:36.685362 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:36.743071 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977440f-354f-4254-8acc-2adadb119196 service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:36.747137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd701a3-c8bc-4819-bfdc-4ae0a6b6b906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:36.747837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd701a3-c8bc-4819-bfdc-4ae0a6b6b906 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:36.748152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd701a3-c8bc-4819-bfdc-4ae0a6b6b906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:36.748351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd701a3-c8bc-4819-bfdc-4ae0a6b6b906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:36.750128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-fcd701a3-c8bc-4819-bfdc-4ae0a6b6b906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:36.761039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd701a3-c8bc-4819-bfdc-4ae0a6b6b906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:36.763183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd701a3-c8bc-4819-bfdc-4ae0a6b6b906 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:36.771533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1337/2707] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:43.362806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=36 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:46.740302 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b46e2f-50c8-4128-9873-c6019909b825 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:46.741863 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c5b46e2f-50c8-4128-9873-c6019909b825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:46.768414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=48 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:46.827775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b46e2f-50c8-4128-9873-c6019909b825 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:46.833485 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:46.834389 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:46.834673 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:46.834954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] PATH_INFO: `/v3/users/46049becd0c9464ba13d103c5ec9bc4d` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:46.836308 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46049becd0c9464ba13d103c5ec9bc4d)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:46.840549 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:46.899015 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46049becd0c9464ba13d103c5ec9bc4d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:46.906306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46049becd0c9464ba13d103c5ec9bc4d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:46.907019 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46049becd0c9464ba13d103c5ec9bc4d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:46.915488 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46049becd0c9464ba13d103c5ec9bc4d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:46.930700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46049becd0c9464ba13d103c5ec9bc4d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:46.938124 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1371/2708] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:46 2022] DELETE /identity/v3/users/46049becd0c9464ba13d103c5ec9bc4d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:46.942935 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6f4cb-2f8f-45fe-b654-6b5b0ff94717 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:46.943174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6f4cb-2f8f-45fe-b654-6b5b0ff94717 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:46.943494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6f4cb-2f8f-45fe-b654-6b5b0ff94717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:46.960678 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-a1d6f4cb-2f8f-45fe-b654-6b5b0ff94717 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:46.961891 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-a1d6f4cb-2f8f-45fe-b654-6b5b0ff94717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:47.031643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1338/2709] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:47.038028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:47.039606 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:47.108502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89e7f7-618b-4f77-a0fe-205cce78a856 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:47.112528 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1598e6d-099a-4557-ae48-43812142661a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:47.113201 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1598e6d-099a-4557-ae48-43812142661a service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:47.113551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1598e6d-099a-4557-ae48-43812142661a service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:47.113842 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1598e6d-099a-4557-ae48-43812142661a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:47.118401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6f4cb-2f8f-45fe-b654-6b5b0ff94717 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:47.127247 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1598e6d-099a-4557-ae48-43812142661a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:47.128773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1598e6d-099a-4557-ae48-43812142661a service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:47.128994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6f4cb-2f8f-45fe-b654-6b5b0ff94717 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:47.133150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af0477-22d6-400c-84c5-e33d28f707d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:47.133866 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af0477-22d6-400c-84c5-e33d28f707d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:47.134146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af0477-22d6-400c-84c5-e33d28f707d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:47.134469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af0477-22d6-400c-84c5-e33d28f707d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:47.136583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d9af0477-22d6-400c-84c5-e33d28f707d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:47.140260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1372/2710] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:47.210008 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af0477-22d6-400c-84c5-e33d28f707d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:47.211461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af0477-22d6-400c-84c5-e33d28f707d8 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:47.222630 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1339/2711] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:28:47.595790 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1598e6d-099a-4557-ae48-43812142661a service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:47.597250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a1598e6d-099a-4557-ae48-43812142661a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:47.610253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1598e6d-099a-4557-ae48-43812142661a service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:47.614967 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:47.615853 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:47.616135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:47.616415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] PATH_INFO: `/v3/projects/175e67b46fe34e3eba778f28dd3322b1` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:47.617595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] RBAC: Authorizing `identity:delete_project(project_id=175e67b46fe34e3eba778f28dd3322b1)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:47.619517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:47.637627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:47.674785 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175e67b46fe34e3eba778f28dd3322b1', 'request_id': 'req-c7a67523-3d7d-40bf-9c98-071ee62e663b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.682633 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175e67b46fe34e3eba778f28dd3322b1', 'request_id': 'req-c7a67523-3d7d-40bf-9c98-071ee62e663b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.689293 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175e67b46fe34e3eba778f28dd3322b1', 'request_id': 'req-c7a67523-3d7d-40bf-9c98-071ee62e663b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.701365 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] The token cache is being invalidate because project 175e67b46fe34e3eba778f28dd3322b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:47.701914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.702562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.704152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1373/2712] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:47 2022] DELETE /identity/v3/projects/175e67b46fe34e3eba778f28dd3322b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:47.708301 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af0477-22d6-400c-84c5-e33d28f707d8 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:47.720182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af0477-22d6-400c-84c5-e33d28f707d8 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:47.780066 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:47.780949 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:47.781231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:47.781504 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] PATH_INFO: `/v3/users/940f460c652e4de29bfe821605ce7093` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:47.782718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=940f460c652e4de29bfe821605ce7093)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:47.784673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:47.825849 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:47.836224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '940f460c652e4de29bfe821605ce7093'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.836890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '940f460c652e4de29bfe821605ce7093'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.846731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '940f460c652e4de29bfe821605ce7093'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.847472 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '940f460c652e4de29bfe821605ce7093'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.855167 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-9f2e1de6-2867-4fda-8eb6-5f8e91e6b7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '940f460c652e4de29bfe821605ce7093'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:47.874367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1340/2713] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:47 2022] DELETE /identity/v3/users/940f460c652e4de29bfe821605ce7093 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:48.169294 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:48.170744 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:48.184454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a67523-3d7d-40bf-9c98-071ee62e663b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:48.251978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:48.253814 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:48.254299 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:48.254736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] PATH_INFO: `/v3/users/599ba2d575aa4e1f92599cfcccb2d6ea` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:48.256783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599ba2d575aa4e1f92599cfcccb2d6ea)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:48.258875 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:48.315082 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599ba2d575aa4e1f92599cfcccb2d6ea'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.323261 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599ba2d575aa4e1f92599cfcccb2d6ea'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.324284 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599ba2d575aa4e1f92599cfcccb2d6ea'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.340958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599ba2d575aa4e1f92599cfcccb2d6ea'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.374414 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599ba2d575aa4e1f92599cfcccb2d6ea'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.381942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1374/2714] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:48 2022] DELETE /identity/v3/users/599ba2d575aa4e1f92599cfcccb2d6ea => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:48.386684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd5a6e-98aa-4a10-af81-436feff6bc84 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:48.386972 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd5a6e-98aa-4a10-af81-436feff6bc84 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:48.387386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd5a6e-98aa-4a10-af81-436feff6bc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:48.395178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:48.401996 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:48.421993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b9dd5a6e-98aa-4a10-af81-436feff6bc84 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:48.423274 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b9dd5a6e-98aa-4a10-af81-436feff6bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:48.461981 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:48.549844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd8b8d-e612-42ad-b057-fc1922ff4539 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:48.563312 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:48.564230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:48.564517 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:48.564798 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] PATH_INFO: `/v3/projects/470337ddfbe0466cb061f6742c2bfba7` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:48.566504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=470337ddfbe0466cb061f6742c2bfba7)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:48.568471 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:48.577384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1341/2715] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:48.584069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd5a6e-98aa-4a10-af81-436feff6bc84 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:48.585558 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b9dd5a6e-98aa-4a10-af81-436feff6bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:48.664776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470337ddfbe0466cb061f6742c2bfba7', 'request_id': 'req-3900e44d-cda7-4e92-85b4-143deb7e66b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.665033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd5a6e-98aa-4a10-af81-436feff6bc84 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:48.675432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470337ddfbe0466cb061f6742c2bfba7', 'request_id': 'req-3900e44d-cda7-4e92-85b4-143deb7e66b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.681786 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470337ddfbe0466cb061f6742c2bfba7', 'request_id': 'req-3900e44d-cda7-4e92-85b4-143deb7e66b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.698784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] The token cache is being invalidate because project 470337ddfbe0466cb061f6742c2bfba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:48.699145 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.700075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3900e44d-cda7-4e92-85b4-143deb7e66b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:48.706618 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1375/2716] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:48 2022] DELETE /identity/v3/projects/470337ddfbe0466cb061f6742c2bfba7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:48.708384 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c802d-1af6-4fbe-9d5c-9a234d5909d4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:48.708676 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c802d-1af6-4fbe-9d5c-9a234d5909d4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:48.708954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c802d-1af6-4fbe-9d5c-9a234d5909d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:48.734921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9eca0-f8f2-4e5d-8393-e2dcb630ef2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:48.735779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9eca0-f8f2-4e5d-8393-e2dcb630ef2a service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:48.736142 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9a2c802d-1af6-4fbe-9d5c-9a234d5909d4 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:48.736280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9eca0-f8f2-4e5d-8393-e2dcb630ef2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:48.737688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9a2c802d-1af6-4fbe-9d5c-9a234d5909d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:48.749228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9eca0-f8f2-4e5d-8393-e2dcb630ef2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:48.753621 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-01f9eca0-f8f2-4e5d-8393-e2dcb630ef2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:48.786177 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:48.817014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1376/2717] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:48.825107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736e04e-6c11-44ed-a63a-18d6f9943b41 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:48.825925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736e04e-6c11-44ed-a63a-18d6f9943b41 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:48.825925 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736e04e-6c11-44ed-a63a-18d6f9943b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:48.835242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9eca0-f8f2-4e5d-8393-e2dcb630ef2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:48.836825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9eca0-f8f2-4e5d-8393-e2dcb630ef2a service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:48.846075 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e736e04e-6c11-44ed-a63a-18d6f9943b41 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:48.847304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e736e04e-6c11-44ed-a63a-18d6f9943b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:48.847549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1342/2718] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:48.856457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1377/2719] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:48.860292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9eca0-f8f2-4e5d-8393-e2dcb630ef2a service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:48.871308 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9eca0-f8f2-4e5d-8393-e2dcb630ef2a service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:48.876837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e2250-758a-4d31-b8fe-8091dabf3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:48.877617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e2250-758a-4d31-b8fe-8091dabf3eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:48.877741 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e2250-758a-4d31-b8fe-8091dabf3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:48.878140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e2250-758a-4d31-b8fe-8091dabf3eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:48.878679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e2250-758a-4d31-b8fe-8091dabf3eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:28:48.878988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e2250-758a-4d31-b8fe-8091dabf3eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:48.880773 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e2250-758a-4d31-b8fe-8091dabf3eb3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:48.894465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1343/2720] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:28:48.899735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736e04e-6c11-44ed-a63a-18d6f9943b41 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:48.910052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736e04e-6c11-44ed-a63a-18d6f9943b41 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:48.915470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57987a-30c9-4b28-9778-11b1cf244117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:48.916160 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57987a-30c9-4b28-9778-11b1cf244117 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:48.917025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57987a-30c9-4b28-9778-11b1cf244117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:48.917313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57987a-30c9-4b28-9778-11b1cf244117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:48.918062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57987a-30c9-4b28-9778-11b1cf244117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:48.920056 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57987a-30c9-4b28-9778-11b1cf244117 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:48.950773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1378/2721] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:48 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:48.955316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e2250-758a-4d31-b8fe-8091dabf3eb3 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:48.966969 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e2250-758a-4d31-b8fe-8091dabf3eb3 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:49.037081 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c10ce-44a8-4d38-b215-8d3cb20bef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:49.039534 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c10ce-44a8-4d38-b215-8d3cb20bef71 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.039938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c10ce-44a8-4d38-b215-8d3cb20bef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.040430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c10ce-44a8-4d38-b215-8d3cb20bef71 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.041357 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c10ce-44a8-4d38-b215-8d3cb20bef71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:49.044552 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c10ce-44a8-4d38-b215-8d3cb20bef71 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:49.074641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1344/2722] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:48 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:28:49.075788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57987a-30c9-4b28-9778-11b1cf244117 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:49.086152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57987a-30c9-4b28-9778-11b1cf244117 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:49.093338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785075b1-5e06-42d7-ab38-77a8cf971b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:49.094042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785075b1-5e06-42d7-ab38-77a8cf971b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.094314 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785075b1-5e06-42d7-ab38-77a8cf971b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.094594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785075b1-5e06-42d7-ab38-77a8cf971b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.095468 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785075b1-5e06-42d7-ab38-77a8cf971b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:49.096969 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785075b1-5e06-42d7-ab38-77a8cf971b3d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:49.112607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1379/2723] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:49.116311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c10ce-44a8-4d38-b215-8d3cb20bef71 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:49.127391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c10ce-44a8-4d38-b215-8d3cb20bef71 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:49.133852 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60e21b-a1ec-4319-87ca-7dbec961d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:49.134569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60e21b-a1ec-4319-87ca-7dbec961d6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.134835 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60e21b-a1ec-4319-87ca-7dbec961d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.135138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60e21b-a1ec-4319-87ca-7dbec961d6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.135983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60e21b-a1ec-4319-87ca-7dbec961d6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:49.137568 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60e21b-a1ec-4319-87ca-7dbec961d6cf admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:49.150186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1345/2724] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:49.154512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785075b1-5e06-42d7-ab38-77a8cf971b3d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:49.157280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60e21b-a1ec-4319-87ca-7dbec961d6cf admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:49.159351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-fa60e21b-a1ec-4319-87ca-7dbec961d6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:49.168278 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785075b1-5e06-42d7-ab38-77a8cf971b3d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:49.175452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988077b9-3121-4bce-8732-8d5b9f2b8570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:49.176099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60e21b-a1ec-4319-87ca-7dbec961d6cf admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:49.177296 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988077b9-3121-4bce-8732-8d5b9f2b8570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.177756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988077b9-3121-4bce-8732-8d5b9f2b8570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.178230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988077b9-3121-4bce-8732-8d5b9f2b8570 admin admin] PATH_INFO: `/v3/projects/5bc9053db4d1408099c32cb3f1505db3/users/d2eb667d05614e39a1e7161f474ab1bf/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.181483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:49.183019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.183435 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.185303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] PATH_INFO: `/v3/projects/148db0164a6d4cdd99fe7a04aef7f082` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.185922 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=148db0164a6d4cdd99fe7a04aef7f082)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:49.188209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:49.204193 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:49.209459 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988077b9-3121-4bce-8732-8d5b9f2b8570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc9053db4d1408099c32cb3f1505db3, user_id=d2eb667d05614e39a1e7161f474ab1bf, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:49.212406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988077b9-3121-4bce-8732-8d5b9f2b8570 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:49.234258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1380/2725] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:49 2022] PUT /identity/v3/projects/5bc9053db4d1408099c32cb3f1505db3/users/d2eb667d05614e39a1e7161f474ab1bf/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:49.244334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338115-9386-4369-8306-6cca6407538a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.244762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338115-9386-4369-8306-6cca6407538a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.244953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338115-9386-4369-8306-6cca6407538a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.249129 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148db0164a6d4cdd99fe7a04aef7f082', 'request_id': 'req-eb3a60fc-2947-4d62-badc-fe70056ce5d1'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.257760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148db0164a6d4cdd99fe7a04aef7f082', 'request_id': 'req-eb3a60fc-2947-4d62-badc-fe70056ce5d1'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.267687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148db0164a6d4cdd99fe7a04aef7f082', 'request_id': 'req-eb3a60fc-2947-4d62-badc-fe70056ce5d1'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.273182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ed338115-9386-4369-8306-6cca6407538a None None] MFA Rules not processed for user `d2eb667d05614e39a1e7161f474ab1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:49.274415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ed338115-9386-4369-8306-6cca6407538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:49.281199 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] The token cache is being invalidate because project 148db0164a6d4cdd99fe7a04aef7f082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:49.281563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.282262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.284134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1346/2726] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:49 2022] DELETE /identity/v3/projects/148db0164a6d4cdd99fe7a04aef7f082 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:49.287651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:49.289601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:49.303157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:49.347515 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1381/2727] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:49.363431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338115-9386-4369-8306-6cca6407538a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:49.365913 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ed338115-9386-4369-8306-6cca6407538a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:49.370788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a60fc-2947-4d62-badc-fe70056ce5d1 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:49.375817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:49.376810 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.377185 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.377556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] PATH_INFO: `/v3/users/8aab2010b02445c48df68a424ff27a66` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.378854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aab2010b02445c48df68a424ff27a66)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:49.380970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:49.433783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aab2010b02445c48df68a424ff27a66'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.434715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aab2010b02445c48df68a424ff27a66'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.438464 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed338115-9386-4369-8306-6cca6407538a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:49.443514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aab2010b02445c48df68a424ff27a66'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.444231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aab2010b02445c48df68a424ff27a66'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.450697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327878a5-dc64-436a-8f9c-cfa5068460f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:49.452360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327878a5-dc64-436a-8f9c-cfa5068460f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.452830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327878a5-dc64-436a-8f9c-cfa5068460f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.453684 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aab2010b02445c48df68a424ff27a66'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.454334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327878a5-dc64-436a-8f9c-cfa5068460f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.457550 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-327878a5-dc64-436a-8f9c-cfa5068460f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:49.473690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327878a5-dc64-436a-8f9c-cfa5068460f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:49.475445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327878a5-dc64-436a-8f9c-cfa5068460f5 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:49.475782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1347/2728] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:49 2022] DELETE /identity/v3/users/8aab2010b02445c48df68a424ff27a66 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:49.499625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1382/2729] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:49.512077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:49.513647 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:49.607210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b40c1-1ef9-40e7-9887-df4bc7d68339 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:49.612939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:49.613837 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.614169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.614858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] PATH_INFO: `/v3/users/d2eb667d05614e39a1e7161f474ab1bf` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.616155 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2eb667d05614e39a1e7161f474ab1bf)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:49.618317 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:49.675973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:49.703611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2eb667d05614e39a1e7161f474ab1bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.705235 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2eb667d05614e39a1e7161f474ab1bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.729197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2eb667d05614e39a1e7161f474ab1bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.730099 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2eb667d05614e39a1e7161f474ab1bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.741963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2eb667d05614e39a1e7161f474ab1bf'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.774250 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1348/2730] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:49 2022] DELETE /identity/v3/users/d2eb667d05614e39a1e7161f474ab1bf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:49.779306 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3177c-b8cd-4c5c-9eea-0299c779bb8f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.779722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3177c-b8cd-4c5c-9eea-0299c779bb8f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.780183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3177c-b8cd-4c5c-9eea-0299c779bb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.810906 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:49.812549 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:49.832805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-58c3177c-b8cd-4c5c-9eea-0299c779bb8f None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:49.854496 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-58c3177c-b8cd-4c5c-9eea-0299c779bb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:49.906191 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed645f0-2c71-41a6-9823-fef868e51af1 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:49.912035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:49.913046 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:49.913434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:49.913953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] PATH_INFO: `/v3/projects/b023f9b41005477688779f13675c9df0` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:49.915578 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b023f9b41005477688779f13675c9df0)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:49.919379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:49.972763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b023f9b41005477688779f13675c9df0', 'request_id': 'req-276270ab-b180-4103-885e-dc0d96b6069f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.974835 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1383/2731] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:49.981945 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b023f9b41005477688779f13675c9df0', 'request_id': 'req-276270ab-b180-4103-885e-dc0d96b6069f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:49.985916 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3177c-b8cd-4c5c-9eea-0299c779bb8f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:49.987494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-58c3177c-b8cd-4c5c-9eea-0299c779bb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:49.993646 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b023f9b41005477688779f13675c9df0', 'request_id': 'req-276270ab-b180-4103-885e-dc0d96b6069f'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:50.006229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] The token cache is being invalidate because project b023f9b41005477688779f13675c9df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:50.006524 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:50.007202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-276270ab-b180-4103-885e-dc0d96b6069f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:50.009204 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1349/2732] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:49 2022] DELETE /identity/v3/projects/b023f9b41005477688779f13675c9df0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:50.014166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3814-9b4a-498c-8318-aff459dd2744 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.015850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3814-9b4a-498c-8318-aff459dd2744 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.016280 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3814-9b4a-498c-8318-aff459dd2744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.027593 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:50.039710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-308f3814-9b4a-498c-8318-aff459dd2744 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:50.040943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-308f3814-9b4a-498c-8318-aff459dd2744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:50.070728 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3177c-b8cd-4c5c-9eea-0299c779bb8f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.080843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:50.122790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1350/2733] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:50.129876 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434a10-620f-4197-b7ee-2d6d3e26cd8d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.130255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434a10-620f-4197-b7ee-2d6d3e26cd8d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.131067 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434a10-620f-4197-b7ee-2d6d3e26cd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.144811 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa30de-e700-43db-9898-e841300790bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.145478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa30de-e700-43db-9898-e841300790bd service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.145760 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa30de-e700-43db-9898-e841300790bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.146043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa30de-e700-43db-9898-e841300790bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.148266 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-48fa30de-e700-43db-9898-e841300790bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:50.150639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-55434a10-620f-4197-b7ee-2d6d3e26cd8d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:50.152585 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-55434a10-620f-4197-b7ee-2d6d3e26cd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:50.161120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1351/2734] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:50.164886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa30de-e700-43db-9898-e841300790bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.165246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434a10-620f-4197-b7ee-2d6d3e26cd8d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.167224 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa30de-e700-43db-9898-e841300790bd service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.175991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434a10-620f-4197-b7ee-2d6d3e26cd8d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.180975 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608fa5f-09e2-4700-82ce-69a5ad5fb33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.181638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608fa5f-09e2-4700-82ce-69a5ad5fb33a admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.181928 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608fa5f-09e2-4700-82ce-69a5ad5fb33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.182217 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1384/2735] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:28:50.182737 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608fa5f-09e2-4700-82ce-69a5ad5fb33a admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.183002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608fa5f-09e2-4700-82ce-69a5ad5fb33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:28:50.183379 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608fa5f-09e2-4700-82ce-69a5ad5fb33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.185269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608fa5f-09e2-4700-82ce-69a5ad5fb33a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.198784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1352/2736] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:28:50.203037 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa30de-e700-43db-9898-e841300790bd service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.216840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa30de-e700-43db-9898-e841300790bd service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.224472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e7c93-ab4f-4fb4-b819-c4ed5d6ccbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.224823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e7c93-ab4f-4fb4-b819-c4ed5d6ccbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.225115 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e7c93-ab4f-4fb4-b819-c4ed5d6ccbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.226651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e7c93-ab4f-4fb4-b819-c4ed5d6ccbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.227388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e7c93-ab4f-4fb4-b819-c4ed5d6ccbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.231486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e7c93-ab4f-4fb4-b819-c4ed5d6ccbe3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.273951 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1385/2737] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:28:50.278728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608fa5f-09e2-4700-82ce-69a5ad5fb33a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.289854 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608fa5f-09e2-4700-82ce-69a5ad5fb33a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.386260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8e9d-b7d9-4650-bf33-d44bbec5d291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.387697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8e9d-b7d9-4650-bf33-d44bbec5d291 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.387990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8e9d-b7d9-4650-bf33-d44bbec5d291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.388704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8e9d-b7d9-4650-bf33-d44bbec5d291 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.389045 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa8e9d-b7d9-4650-bf33-d44bbec5d291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.391004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa8e9d-b7d9-4650-bf33-d44bbec5d291 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.421576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1353/2738] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:50.424027 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e7c93-ab4f-4fb4-b819-c4ed5d6ccbe3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.437700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e7c93-ab4f-4fb4-b819-c4ed5d6ccbe3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.442887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfce80-3a7d-46c1-b37b-42c7ca9aeeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.443906 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfce80-3a7d-46c1-b37b-42c7ca9aeeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.444417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfce80-3a7d-46c1-b37b-42c7ca9aeeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.444899 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfce80-3a7d-46c1-b37b-42c7ca9aeeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.445862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfce80-3a7d-46c1-b37b-42c7ca9aeeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.448575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfce80-3a7d-46c1-b37b-42c7ca9aeeb6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.462801 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1386/2739] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:50.467242 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8e9d-b7d9-4650-bf33-d44bbec5d291 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.485349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8e9d-b7d9-4650-bf33-d44bbec5d291 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.492911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea100ae7-d481-4b21-b3ee-9ee223b88c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.493611 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea100ae7-d481-4b21-b3ee-9ee223b88c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.493895 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea100ae7-d481-4b21-b3ee-9ee223b88c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.494174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea100ae7-d481-4b21-b3ee-9ee223b88c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.495266 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea100ae7-d481-4b21-b3ee-9ee223b88c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.498850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea100ae7-d481-4b21-b3ee-9ee223b88c88 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.512360 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1354/2740] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:50.517153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfce80-3a7d-46c1-b37b-42c7ca9aeeb6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.533796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfce80-3a7d-46c1-b37b-42c7ca9aeeb6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.534911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea100ae7-d481-4b21-b3ee-9ee223b88c88 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.536967 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ea100ae7-d481-4b21-b3ee-9ee223b88c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:50.542763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15c941-385a-4b2e-bf16-f945b0f68c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.543912 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15c941-385a-4b2e-bf16-f945b0f68c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.544380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15c941-385a-4b2e-bf16-f945b0f68c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.544824 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15c941-385a-4b2e-bf16-f945b0f68c61 admin admin] PATH_INFO: `/v3/projects/8b9ae500e50f45fbb64a17b3cc5e146a/users/fa0f46b84eb846689ff92298ed47803a/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.563152 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea100ae7-d481-4b21-b3ee-9ee223b88c88 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.571859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15c941-385a-4b2e-bf16-f945b0f68c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9ae500e50f45fbb64a17b3cc5e146a, user_id=fa0f46b84eb846689ff92298ed47803a, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.573675 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.574700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.575087 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.575517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] PATH_INFO: `/v3/projects/5bc9053db4d1408099c32cb3f1505db3` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.575902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15c941-385a-4b2e-bf16-f945b0f68c61 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.577207 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc9053db4d1408099c32cb3f1505db3)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.580217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.602920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1387/2741] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:50 2022] PUT /identity/v3/projects/8b9ae500e50f45fbb64a17b3cc5e146a/users/fa0f46b84eb846689ff92298ed47803a/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:50.613073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9948d7-dc00-48bf-bbff-d3b69d0c11c6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.613527 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9948d7-dc00-48bf-bbff-d3b69d0c11c6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.613648 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9948d7-dc00-48bf-bbff-d3b69d0c11c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.644347 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc9053db4d1408099c32cb3f1505db3', 'request_id': 'req-bead35e7-2097-437c-a82a-a0ec1e817f67'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:50.653043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc9053db4d1408099c32cb3f1505db3', 'request_id': 'req-bead35e7-2097-437c-a82a-a0ec1e817f67'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:50.659009 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ba9948d7-dc00-48bf-bbff-d3b69d0c11c6 None None] MFA Rules not processed for user `fa0f46b84eb846689ff92298ed47803a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:50.660766 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ba9948d7-dc00-48bf-bbff-d3b69d0c11c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:50.663988 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc9053db4d1408099c32cb3f1505db3', 'request_id': 'req-bead35e7-2097-437c-a82a-a0ec1e817f67'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:50.676705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] The token cache is being invalidate because project 5bc9053db4d1408099c32cb3f1505db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:50.677021 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:50.677674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-bead35e7-2097-437c-a82a-a0ec1e817f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:50.679404 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1355/2742] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:50 2022] DELETE /identity/v3/projects/5bc9053db4d1408099c32cb3f1505db3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:50.684429 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb33c2-a357-4c56-bb7b-b2e98f3ac933 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.684712 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb33c2-a357-4c56-bb7b-b2e98f3ac933 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.685252 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb33c2-a357-4c56-bb7b-b2e98f3ac933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.705951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-70fb33c2-a357-4c56-bb7b-b2e98f3ac933 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:50.707194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-70fb33c2-a357-4c56-bb7b-b2e98f3ac933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:50.726231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:50.768596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1388/2743] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:50.772775 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9948d7-dc00-48bf-bbff-d3b69d0c11c6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.774212 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ba9948d7-dc00-48bf-bbff-d3b69d0c11c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:50.800252 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:50.800517 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1356/2744] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:50.808614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80940e-4972-4b2f-ada2-29ff95fb2fa7 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.809241 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80940e-4972-4b2f-ada2-29ff95fb2fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.811715 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80940e-4972-4b2f-ada2-29ff95fb2fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.834220 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-0e80940e-4972-4b2f-ada2-29ff95fb2fa7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:50.835686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0e80940e-4972-4b2f-ada2-29ff95fb2fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:50.855180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1357/2745] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:50.859157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80940e-4972-4b2f-ada2-29ff95fb2fa7 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.866108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9948d7-dc00-48bf-bbff-d3b69d0c11c6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.871478 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678ab54-a4d4-4766-be04-197fba1ce31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.872061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678ab54-a4d4-4766-be04-197fba1ce31d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.872331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678ab54-a4d4-4766-be04-197fba1ce31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.872602 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678ab54-a4d4-4766-be04-197fba1ce31d admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.873321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678ab54-a4d4-4766-be04-197fba1ce31d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.873818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80940e-4972-4b2f-ada2-29ff95fb2fa7 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.875202 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678ab54-a4d4-4766-be04-197fba1ce31d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.880336 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65262d4-d1a2-40e3-bd08-d63ead2dd79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.881026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65262d4-d1a2-40e3-bd08-d63ead2dd79a admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.881311 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65262d4-d1a2-40e3-bd08-d63ead2dd79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.881594 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65262d4-d1a2-40e3-bd08-d63ead2dd79a admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.882366 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65262d4-d1a2-40e3-bd08-d63ead2dd79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:28:50.882679 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65262d4-d1a2-40e3-bd08-d63ead2dd79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.885047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65262d4-d1a2-40e3-bd08-d63ead2dd79a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.908847 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1358/2746] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:28:50.909061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1389/2747] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:28:50.909195 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65262d4-d1a2-40e3-bd08-d63ead2dd79a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.911862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678ab54-a4d4-4766-be04-197fba1ce31d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:50.919754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65262d4-d1a2-40e3-bd08-d63ead2dd79a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.981991 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cd76c-cd14-4020-a251-a352ac86ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.982682 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cd76c-cd14-4020-a251-a352ac86ffc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.982937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cd76c-cd14-4020-a251-a352ac86ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.983212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cd76c-cd14-4020-a251-a352ac86ffc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.983937 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cd76c-cd14-4020-a251-a352ac86ffc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.985796 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678ab54-a4d4-4766-be04-197fba1ce31d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:50.985979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cd76c-cd14-4020-a251-a352ac86ffc7 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:50.990777 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286f0f2-78c4-4933-8169-42538da3476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:50.991569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286f0f2-78c4-4933-8169-42538da3476e admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:50.991956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286f0f2-78c4-4933-8169-42538da3476e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:50.992321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286f0f2-78c4-4933-8169-42538da3476e admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:50.993107 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286f0f2-78c4-4933-8169-42538da3476e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:50.995165 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286f0f2-78c4-4933-8169-42538da3476e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.018116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1390/2748] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:51.018835 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286f0f2-78c4-4933-8169-42538da3476e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.024013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1359/2749] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:50 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:51.027779 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cd76c-cd14-4020-a251-a352ac86ffc7 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.032359 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286f0f2-78c4-4933-8169-42538da3476e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.090896 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfe8df-f37c-49e3-84bb-f9b7e88472ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.091486 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfe8df-f37c-49e3-84bb-f9b7e88472ee admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.091772 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfe8df-f37c-49e3-84bb-f9b7e88472ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.092051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfe8df-f37c-49e3-84bb-f9b7e88472ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.092776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfe8df-f37c-49e3-84bb-f9b7e88472ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.094352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfe8df-f37c-49e3-84bb-f9b7e88472ee admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.095041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cd76c-cd14-4020-a251-a352ac86ffc7 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.100041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb3cd-4aa1-4786-8d0d-23c7d39c6ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.100842 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb3cd-4aa1-4786-8d0d-23c7d39c6ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.101198 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb3cd-4aa1-4786-8d0d-23c7d39c6ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.101554 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb3cd-4aa1-4786-8d0d-23c7d39c6ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.102303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bb3cd-4aa1-4786-8d0d-23c7d39c6ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.104296 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bb3cd-4aa1-4786-8d0d-23c7d39c6ee3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.107665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1391/2750] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:28:51.108597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfe8df-f37c-49e3-84bb-f9b7e88472ee admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.118844 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfe8df-f37c-49e3-84bb-f9b7e88472ee admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.123753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c659b2-949a-4276-90fa-aec816531c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.124630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c659b2-949a-4276-90fa-aec816531c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.124784 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1360/2751] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:51 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:28:51.127712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c659b2-949a-4276-90fa-aec816531c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.128010 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c659b2-949a-4276-90fa-aec816531c84 admin admin] PATH_INFO: `/v3/projects/1c3d07ca442944de9d388827e9adedd9/users/23ce88c6e87b49fcb926624cdb89b569/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.128537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb3cd-4aa1-4786-8d0d-23c7d39c6ee3 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.138696 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb3cd-4aa1-4786-8d0d-23c7d39c6ee3 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.143443 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3696db-42b2-4bde-896d-add1f3cd3ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.144095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3696db-42b2-4bde-896d-add1f3cd3ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.144385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3696db-42b2-4bde-896d-add1f3cd3ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.144665 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3696db-42b2-4bde-896d-add1f3cd3ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.144871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c659b2-949a-4276-90fa-aec816531c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3d07ca442944de9d388827e9adedd9, user_id=23ce88c6e87b49fcb926624cdb89b569, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.145391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3696db-42b2-4bde-896d-add1f3cd3ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.146964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3696db-42b2-4bde-896d-add1f3cd3ee3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.147595 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c659b2-949a-4276-90fa-aec816531c84 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.158090 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1361/2752] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:28:51.161853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3696db-42b2-4bde-896d-add1f3cd3ee3 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.162977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1392/2753] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:51 2022] PUT /identity/v3/projects/1c3d07ca442944de9d388827e9adedd9/users/23ce88c6e87b49fcb926624cdb89b569/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:51.166444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c659b2-949a-4276-90fa-aec816531c84 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.167909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:51.171163 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:51.171948 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3696db-42b2-4bde-896d-add1f3cd3ee3 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.231105 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706fee6-bd07-4857-9861-bcd7a6ba1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.231396 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c659b2-949a-4276-90fa-aec816531c84 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.231841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706fee6-bd07-4857-9861-bcd7a6ba1507 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.232069 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706fee6-bd07-4857-9861-bcd7a6ba1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.232342 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706fee6-bd07-4857-9861-bcd7a6ba1507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.233095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706fee6-bd07-4857-9861-bcd7a6ba1507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.234674 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706fee6-bd07-4857-9861-bcd7a6ba1507 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.236078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0dec3-64c6-4b3b-9fb4-2a16ae148ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.236754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0dec3-64c6-4b3b-9fb4-2a16ae148ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.237042 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0dec3-64c6-4b3b-9fb4-2a16ae148ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.237319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0dec3-64c6-4b3b-9fb4-2a16ae148ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.238046 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0dec3-64c6-4b3b-9fb4-2a16ae148ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.239651 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0dec3-64c6-4b3b-9fb4-2a16ae148ff9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.244496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1362/2754] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:28:51.248447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706fee6-bd07-4857-9861-bcd7a6ba1507 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.253470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1393/2755] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:28:51.254619 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0dec3-64c6-4b3b-9fb4-2a16ae148ff9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.257818 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706fee6-bd07-4857-9861-bcd7a6ba1507 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.262919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376b799-6ed2-4e68-8b8b-8577d3bf8542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.263812 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376b799-6ed2-4e68-8b8b-8577d3bf8542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.264094 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376b799-6ed2-4e68-8b8b-8577d3bf8542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.264367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376b799-6ed2-4e68-8b8b-8577d3bf8542 admin admin] PATH_INFO: `/v3/projects/66eeecc5a4ce4310b1ce1119c146d2e8/users/e7537024ebe54ceabad7af317f3f977b/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.265514 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0dec3-64c6-4b3b-9fb4-2a16ae148ff9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.270441 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06846b90-0bac-4707-b6ba-7abbe3ea8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.271328 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06846b90-0bac-4707-b6ba-7abbe3ea8e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.271662 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06846b90-0bac-4707-b6ba-7abbe3ea8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.271952 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06846b90-0bac-4707-b6ba-7abbe3ea8e89 admin admin] PATH_INFO: `/v3/projects/1c3d07ca442944de9d388827e9adedd9/users/23ce88c6e87b49fcb926624cdb89b569/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.273960 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06846b90-0bac-4707-b6ba-7abbe3ea8e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3d07ca442944de9d388827e9adedd9, user_id=23ce88c6e87b49fcb926624cdb89b569, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.277290 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06846b90-0bac-4707-b6ba-7abbe3ea8e89 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.281187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376b799-6ed2-4e68-8b8b-8577d3bf8542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66eeecc5a4ce4310b1ce1119c146d2e8, user_id=e7537024ebe54ceabad7af317f3f977b, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.283843 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376b799-6ed2-4e68-8b8b-8577d3bf8542 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.288416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1394/2756] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:51 2022] PUT /identity/v3/projects/1c3d07ca442944de9d388827e9adedd9/users/23ce88c6e87b49fcb926624cdb89b569/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:51.299006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1363/2757] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:51 2022] PUT /identity/v3/projects/66eeecc5a4ce4310b1ce1119c146d2e8/users/e7537024ebe54ceabad7af317f3f977b/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:51.301167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedcf4c-cb2e-4f48-a4be-b4d08102fdef None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.301560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedcf4c-cb2e-4f48-a4be-b4d08102fdef None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.301942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedcf4c-cb2e-4f48-a4be-b4d08102fdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.303964 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5206c-eae4-4466-b56b-f1536f662605 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.304425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5206c-eae4-4466-b56b-f1536f662605 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.304944 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5206c-eae4-4466-b56b-f1536f662605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.323700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-85b5206c-eae4-4466-b56b-f1536f662605 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:51.324911 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-85b5206c-eae4-4466-b56b-f1536f662605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:51.332755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0cedcf4c-cb2e-4f48-a4be-b4d08102fdef None None] MFA Rules not processed for user `23ce88c6e87b49fcb926624cdb89b569`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:51.334062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0cedcf4c-cb2e-4f48-a4be-b4d08102fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:51.390898 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1364/2758] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:51.402187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5206c-eae4-4466-b56b-f1536f662605 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.403625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-85b5206c-eae4-4466-b56b-f1536f662605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:51.416523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1395/2759] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:51.428031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedcf4c-cb2e-4f48-a4be-b4d08102fdef None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:51.429442 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0cedcf4c-cb2e-4f48-a4be-b4d08102fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:51.467292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5206c-eae4-4466-b56b-f1536f662605 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.470941 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea228fe-fb21-4d50-8af0-2d61934a9615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.471627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea228fe-fb21-4d50-8af0-2d61934a9615 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.471909 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea228fe-fb21-4d50-8af0-2d61934a9615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.472186 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea228fe-fb21-4d50-8af0-2d61934a9615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.481389 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea228fe-fb21-4d50-8af0-2d61934a9615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.482820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea228fe-fb21-4d50-8af0-2d61934a9615 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.487737 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedcf4c-cb2e-4f48-a4be-b4d08102fdef None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:51.491754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a72d8a-4e49-462d-b66d-4010632e0dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:51.492406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a72d8a-4e49-462d-b66d-4010632e0dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:51.492695 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a72d8a-4e49-462d-b66d-4010632e0dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:51.492977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a72d8a-4e49-462d-b66d-4010632e0dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:51.493119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1365/2760] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:28:51.521773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:51.556586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a72d8a-4e49-462d-b66d-4010632e0dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:51.558726 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a72d8a-4e49-462d-b66d-4010632e0dd9 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:51.568900 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1396/2761] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:52.158743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b370fb9-867b-45fd-ae7d-58c7205553cb None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:52.159239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b370fb9-867b-45fd-ae7d-58c7205553cb None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:52.159388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b370fb9-867b-45fd-ae7d-58c7205553cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:52.185644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-6b370fb9-867b-45fd-ae7d-58c7205553cb None None] MFA Rules not processed for user `e7537024ebe54ceabad7af317f3f977b`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:52.186870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6b370fb9-867b-45fd-ae7d-58c7205553cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:52.195194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:52.255746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1366/2762] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:52.267320 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a72d8a-4e49-462d-b66d-4010632e0dd9 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:52.276069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a72d8a-4e49-462d-b66d-4010632e0dd9 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:52.279659 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f8408-a8ea-4b5a-9338-c111b93a1db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:52.280295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8408-a8ea-4b5a-9338-c111b93a1db0 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:52.280575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8408-a8ea-4b5a-9338-c111b93a1db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:52.280849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f8408-a8ea-4b5a-9338-c111b93a1db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:52.289029 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f8408-a8ea-4b5a-9338-c111b93a1db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:52.290435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f8408-a8ea-4b5a-9338-c111b93a1db0 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:52.299714 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1397/2763] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:52.943662 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b370fb9-867b-45fd-ae7d-58c7205553cb None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:52.945111 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-6b370fb9-867b-45fd-ae7d-58c7205553cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:52.957203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b370fb9-867b-45fd-ae7d-58c7205553cb None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:52.960782 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccfb38-bf6b-484b-80b0-8605ffed81bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:52.961422 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccfb38-bf6b-484b-80b0-8605ffed81bd service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:52.961705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccfb38-bf6b-484b-80b0-8605ffed81bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:52.961981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccfb38-bf6b-484b-80b0-8605ffed81bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:52.971303 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccfb38-bf6b-484b-80b0-8605ffed81bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:52.972752 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccfb38-bf6b-484b-80b0-8605ffed81bd service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:52.982857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1367/2764] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:53.634663 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60efbc-e72e-452c-980d-b029cd75985d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:53.635178 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60efbc-e72e-452c-980d-b029cd75985d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:53.635283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60efbc-e72e-452c-980d-b029cd75985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:53.652023 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4f60efbc-e72e-452c-980d-b029cd75985d None None] MFA Rules not processed for user `e7537024ebe54ceabad7af317f3f977b`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:53.653209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4f60efbc-e72e-452c-980d-b029cd75985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:53.660349 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1398/2765] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:28:56.737350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccfb38-bf6b-484b-80b0-8605ffed81bd service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:56.747851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccfb38-bf6b-484b-80b0-8605ffed81bd service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:56.752400 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:56.753269 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:56.753548 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:56.753821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] PATH_INFO: `/v3/users/fa0f46b84eb846689ff92298ed47803a` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:56.755011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0f46b84eb846689ff92298ed47803a)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:56.756951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:56.805268 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0f46b84eb846689ff92298ed47803a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:56.805921 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0f46b84eb846689ff92298ed47803a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:56.814176 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0f46b84eb846689ff92298ed47803a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:56.814796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0f46b84eb846689ff92298ed47803a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:56.823234 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0f46b84eb846689ff92298ed47803a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:56.843282 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1368/2766] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:56 2022] DELETE /identity/v3/users/fa0f46b84eb846689ff92298ed47803a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:56.847905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16908f62-3d59-4640-b140-5ed5d6f05b93 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:56.848439 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16908f62-3d59-4640-b140-5ed5d6f05b93 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:56.848565 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16908f62-3d59-4640-b140-5ed5d6f05b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:56.867313 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-16908f62-3d59-4640-b140-5ed5d6f05b93 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:56.868541 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-16908f62-3d59-4640-b140-5ed5d6f05b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:56.926077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1399/2767] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:56.936036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:56.937556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:56.994093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672846fa-d9e9-41a3-85c5-81ad4d018902 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:56.997666 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1efc89-495d-4f7b-8c83-98e39a7ae2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:56.998299 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1efc89-495d-4f7b-8c83-98e39a7ae2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:56.998583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1efc89-495d-4f7b-8c83-98e39a7ae2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:56.998858 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1efc89-495d-4f7b-8c83-98e39a7ae2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:57.007791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1efc89-495d-4f7b-8c83-98e39a7ae2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:57.009232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1efc89-495d-4f7b-8c83-98e39a7ae2b3 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:57.018643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1369/2768] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:57.286597 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16908f62-3d59-4640-b140-5ed5d6f05b93 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:57.288108 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-16908f62-3d59-4640-b140-5ed5d6f05b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:57.300383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16908f62-3d59-4640-b140-5ed5d6f05b93 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:57.305068 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:57.306006 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:57.306355 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:57.306700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] PATH_INFO: `/v3/projects/8b9ae500e50f45fbb64a17b3cc5e146a` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:57.307992 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9ae500e50f45fbb64a17b3cc5e146a)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:57.310447 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:57.357346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9ae500e50f45fbb64a17b3cc5e146a', 'request_id': 'req-4807861b-59af-4c79-8838-51f436aa4289'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.366456 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9ae500e50f45fbb64a17b3cc5e146a', 'request_id': 'req-4807861b-59af-4c79-8838-51f436aa4289'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.372406 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9ae500e50f45fbb64a17b3cc5e146a', 'request_id': 'req-4807861b-59af-4c79-8838-51f436aa4289'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.383545 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] The token cache is being invalidate because project 8b9ae500e50f45fbb64a17b3cc5e146a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:57.383830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.384458 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.385977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1400/2769] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:57 2022] DELETE /identity/v3/projects/8b9ae500e50f45fbb64a17b3cc5e146a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:57.390497 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1efc89-495d-4f7b-8c83-98e39a7ae2b3 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:57.400262 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1efc89-495d-4f7b-8c83-98e39a7ae2b3 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:57.408925 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:57.459514 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:57.460386 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:57.460670 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:57.460947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] PATH_INFO: `/v3/users/23ce88c6e87b49fcb926624cdb89b569` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:57.462133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ce88c6e87b49fcb926624cdb89b569)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:57.464093 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:57.512238 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ce88c6e87b49fcb926624cdb89b569'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.512885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ce88c6e87b49fcb926624cdb89b569'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.519809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ce88c6e87b49fcb926624cdb89b569'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.520436 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ce88c6e87b49fcb926624cdb89b569'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.527673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-d895e5b9-2876-4ddf-9bab-7beb311eb61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ce88c6e87b49fcb926624cdb89b569'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:57.544541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1370/2770] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:28:57 2022] DELETE /identity/v3/users/23ce88c6e87b49fcb926624cdb89b569 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:57.924600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:57.926052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:57.941643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807861b-59af-4c79-8838-51f436aa4289 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:57.969922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:58.004073 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.004942 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.005227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.005505 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] PATH_INFO: `/v3/projects/1c3d07ca442944de9d388827e9adedd9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.006723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3d07ca442944de9d388827e9adedd9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.008773 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.055304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3d07ca442944de9d388827e9adedd9', 'request_id': 'req-4cb5282b-a1dc-479c-bc46-9f1922735283'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:58.063937 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3d07ca442944de9d388827e9adedd9', 'request_id': 'req-4cb5282b-a1dc-479c-bc46-9f1922735283'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:58.069644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3d07ca442944de9d388827e9adedd9', 'request_id': 'req-4cb5282b-a1dc-479c-bc46-9f1922735283'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:58.080799 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] The token cache is being invalidate because project 1c3d07ca442944de9d388827e9adedd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:28:58.081090 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:58.081747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4cb5282b-a1dc-479c-bc46-9f1922735283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:28:58.083303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1401/2771] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:28:57 2022] DELETE /identity/v3/projects/1c3d07ca442944de9d388827e9adedd9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:58.088145 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe47f-cc92-4723-9d57-551c989ab764 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.088652 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe47f-cc92-4723-9d57-551c989ab764 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.088749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abe47f-cc92-4723-9d57-551c989ab764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.106632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-b1abe47f-cc92-4723-9d57-551c989ab764 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:58.107870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b1abe47f-cc92-4723-9d57-551c989ab764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:58.168983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1371/2772] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:58.176445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f746f1e-bd3d-4ad3-bef1-360befc86706 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.176743 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f746f1e-bd3d-4ad3-bef1-360befc86706 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.177025 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f746f1e-bd3d-4ad3-bef1-360befc86706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.196174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3f746f1e-bd3d-4ad3-bef1-360befc86706 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:58.197399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3f746f1e-bd3d-4ad3-bef1-360befc86706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:58.205724 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1402/2773] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:58.210002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe47f-cc92-4723-9d57-551c989ab764 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.222638 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abe47f-cc92-4723-9d57-551c989ab764 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.227817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fdfed-8b35-4efe-80ac-93dd4961208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.228482 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fdfed-8b35-4efe-80ac-93dd4961208a admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.228763 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fdfed-8b35-4efe-80ac-93dd4961208a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.229035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fdfed-8b35-4efe-80ac-93dd4961208a admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.231050 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fdfed-8b35-4efe-80ac-93dd4961208a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:28:58.231533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fdfed-8b35-4efe-80ac-93dd4961208a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.233168 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fdfed-8b35-4efe-80ac-93dd4961208a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.246027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1372/2774] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:28:58.250487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f746f1e-bd3d-4ad3-bef1-360befc86706 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.259633 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f746f1e-bd3d-4ad3-bef1-360befc86706 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.264253 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c0622-3eca-4529-8f4a-584099b68b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.264894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c0622-3eca-4529-8f4a-584099b68b9f admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.265173 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c0622-3eca-4529-8f4a-584099b68b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.265445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c0622-3eca-4529-8f4a-584099b68b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.266135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c0622-3eca-4529-8f4a-584099b68b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.268030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c0622-3eca-4529-8f4a-584099b68b9f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.295032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1403/2775] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:58 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:28:58.299287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fdfed-8b35-4efe-80ac-93dd4961208a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.309338 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fdfed-8b35-4efe-80ac-93dd4961208a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.321702 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:58.367003 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea228c-10f2-44db-b61c-229d00d1f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.367724 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea228c-10f2-44db-b61c-229d00d1f879 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.368013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea228c-10f2-44db-b61c-229d00d1f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.368291 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea228c-10f2-44db-b61c-229d00d1f879 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.368990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea228c-10f2-44db-b61c-229d00d1f879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.370936 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea228c-10f2-44db-b61c-229d00d1f879 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.390178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1373/2776] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:58 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:28:58.394205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c0622-3eca-4529-8f4a-584099b68b9f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.405119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c0622-3eca-4529-8f4a-584099b68b9f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.409988 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9ca52-2d82-4708-abb0-036de9ca6ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.410643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9ca52-2d82-4708-abb0-036de9ca6ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.410927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9ca52-2d82-4708-abb0-036de9ca6ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.411205 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9ca52-2d82-4708-abb0-036de9ca6ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.411970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9ca52-2d82-4708-abb0-036de9ca6ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.413552 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9ca52-2d82-4708-abb0-036de9ca6ca5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.426189 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1404/2777] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:58.430108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea228c-10f2-44db-b61c-229d00d1f879 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.440873 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea228c-10f2-44db-b61c-229d00d1f879 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.445466 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd854d-f114-4309-bfbf-f1981d20a22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.446121 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd854d-f114-4309-bfbf-f1981d20a22a admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.446401 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd854d-f114-4309-bfbf-f1981d20a22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.446690 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd854d-f114-4309-bfbf-f1981d20a22a admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.447507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd854d-f114-4309-bfbf-f1981d20a22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.449189 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd854d-f114-4309-bfbf-f1981d20a22a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.459356 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1374/2778] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:58.463241 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9ca52-2d82-4708-abb0-036de9ca6ca5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.473887 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9ca52-2d82-4708-abb0-036de9ca6ca5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.478522 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b824c-7f0e-4fc8-98c6-57491660f15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.479434 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b824c-7f0e-4fc8-98c6-57491660f15f admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.479716 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b824c-7f0e-4fc8-98c6-57491660f15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.480061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b824c-7f0e-4fc8-98c6-57491660f15f admin admin] PATH_INFO: `/v3/projects/c3a5542937a2471eaa2ba88881b994b7/users/18028849e04849029ca558c3e15fb481/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.496489 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b824c-7f0e-4fc8-98c6-57491660f15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a5542937a2471eaa2ba88881b994b7, user_id=18028849e04849029ca558c3e15fb481, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.499126 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b824c-7f0e-4fc8-98c6-57491660f15f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.512779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1405/2779] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:58 2022] PUT /identity/v3/projects/c3a5542937a2471eaa2ba88881b994b7/users/18028849e04849029ca558c3e15fb481/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:28:58.523175 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b4c85-853c-4ce0-abbb-e25cd8afa4e3 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.523502 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b4c85-853c-4ce0-abbb-e25cd8afa4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.523788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b4c85-853c-4ce0-abbb-e25cd8afa4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.552212 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-3d7b4c85-853c-4ce0-abbb-e25cd8afa4e3 None None] MFA Rules not processed for user `18028849e04849029ca558c3e15fb481`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:58.553455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3d7b4c85-853c-4ce0-abbb-e25cd8afa4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:58.618959 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1375/2780] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:58.623424 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b824c-7f0e-4fc8-98c6-57491660f15f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.684336 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:58.690990 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b824c-7f0e-4fc8-98c6-57491660f15f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.696735 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2db2c-3680-4bd7-958d-de8bcde6d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.697399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2db2c-3680-4bd7-958d-de8bcde6d800 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.697684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2db2c-3680-4bd7-958d-de8bcde6d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.697965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2db2c-3680-4bd7-958d-de8bcde6d800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.699263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2db2c-3680-4bd7-958d-de8bcde6d800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.701192 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2db2c-3680-4bd7-958d-de8bcde6d800 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.726656 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1406/2781] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:28:58 2022] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:28:58.730683 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b4c85-853c-4ce0-abbb-e25cd8afa4e3 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.741194 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b4c85-853c-4ce0-abbb-e25cd8afa4e3 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.798692 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056b358-159e-426c-80ed-effbf194a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.799460 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056b358-159e-426c-80ed-effbf194a18e admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.799750 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056b358-159e-426c-80ed-effbf194a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.800027 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056b358-159e-426c-80ed-effbf194a18e admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.800718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056b358-159e-426c-80ed-effbf194a18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.802626 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056b358-159e-426c-80ed-effbf194a18e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.821580 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1376/2782] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:28:58 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:28:58.826136 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2db2c-3680-4bd7-958d-de8bcde6d800 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.836598 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2db2c-3680-4bd7-958d-de8bcde6d800 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.841958 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313572b-8596-4aea-90a7-e70ab3677ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.842630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313572b-8596-4aea-90a7-e70ab3677ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.842919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313572b-8596-4aea-90a7-e70ab3677ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.843198 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313572b-8596-4aea-90a7-e70ab3677ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.844003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313572b-8596-4aea-90a7-e70ab3677ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.845572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313572b-8596-4aea-90a7-e70ab3677ea4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.859141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1407/2783] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:58.860307 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056b358-159e-426c-80ed-effbf194a18e admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.870614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056b358-159e-426c-80ed-effbf194a18e admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:58.877276 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf96c2f-a55c-415b-aa83-82ee4401e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:58.878425 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf96c2f-a55c-415b-aa83-82ee4401e83d admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:58.878806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf96c2f-a55c-415b-aa83-82ee4401e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:58.879108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf96c2f-a55c-415b-aa83-82ee4401e83d admin admin] PATH_INFO: `/v3/projects/0c8214af4fa041578c4bb6710dacfbe2/users/ef0de1f3c8264920a2cfb7796b63381b/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:58.894114 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:58.899469 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf96c2f-a55c-415b-aa83-82ee4401e83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8214af4fa041578c4bb6710dacfbe2, user_id=ef0de1f3c8264920a2cfb7796b63381b, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:58.903728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf96c2f-a55c-415b-aa83-82ee4401e83d admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:58.921938 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1377/2784] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:58 2022] PUT /identity/v3/projects/0c8214af4fa041578c4bb6710dacfbe2/users/ef0de1f3c8264920a2cfb7796b63381b/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:58.923197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313572b-8596-4aea-90a7-e70ab3677ea4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:58.935472 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313572b-8596-4aea-90a7-e70ab3677ea4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:59.002109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fa0f5-8b77-4370-bacd-43459c10d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:59.002783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa0f5-8b77-4370-bacd-43459c10d7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:59.003069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa0f5-8b77-4370-bacd-43459c10d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:59.003371 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa0f5-8b77-4370-bacd-43459c10d7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:59.004109 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fa0f5-8b77-4370-bacd-43459c10d7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:59.005723 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fa0f5-8b77-4370-bacd-43459c10d7d4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:59.016574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1408/2785] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:28:59.020648 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf96c2f-a55c-415b-aa83-82ee4401e83d admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:59.031216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf96c2f-a55c-415b-aa83-82ee4401e83d admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:59.036159 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c28a4-1906-4da5-84b4-6fe3a2547719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:59.037077 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c28a4-1906-4da5-84b4-6fe3a2547719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:59.037365 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c28a4-1906-4da5-84b4-6fe3a2547719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:59.038230 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c28a4-1906-4da5-84b4-6fe3a2547719 admin admin] PATH_INFO: `/v3/projects/0c8214af4fa041578c4bb6710dacfbe2/users/ef0de1f3c8264920a2cfb7796b63381b/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:59.039772 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c28a4-1906-4da5-84b4-6fe3a2547719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8214af4fa041578c4bb6710dacfbe2, user_id=ef0de1f3c8264920a2cfb7796b63381b, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:59.042418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c28a4-1906-4da5-84b4-6fe3a2547719 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:59.052887 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1378/2786] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:28:59 2022] PUT /identity/v3/projects/0c8214af4fa041578c4bb6710dacfbe2/users/ef0de1f3c8264920a2cfb7796b63381b/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:28:59.064941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1d8b9-ed35-4121-adb2-54939e9c8e55 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:59.065245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1d8b9-ed35-4121-adb2-54939e9c8e55 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:59.065526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1d8b9-ed35-4121-adb2-54939e9c8e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:59.092946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c3e1d8b9-ed35-4121-adb2-54939e9c8e55 None None] MFA Rules not processed for user `ef0de1f3c8264920a2cfb7796b63381b`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:28:59.094078 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c3e1d8b9-ed35-4121-adb2-54939e9c8e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:59.160275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1409/2787] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:28:59 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:28:59.170790 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c28a4-1906-4da5-84b4-6fe3a2547719 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:59.172557 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-af6c28a4-1906-4da5-84b4-6fe3a2547719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:28:59.229246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c28a4-1906-4da5-84b4-6fe3a2547719 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:59.232940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58847ab-6f1f-4e14-898d-a66799e349dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:59.233586 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58847ab-6f1f-4e14-898d-a66799e349dc service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:59.233874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58847ab-6f1f-4e14-898d-a66799e349dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:59.234180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58847ab-6f1f-4e14-898d-a66799e349dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:59.243470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58847ab-6f1f-4e14-898d-a66799e349dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:59.244903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58847ab-6f1f-4e14-898d-a66799e349dc service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:59.254953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1379/2788] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:59 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:28:59.325830 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1d8b9-ed35-4121-adb2-54939e9c8e55 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:28:59.335611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1d8b9-ed35-4121-adb2-54939e9c8e55 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:28:59.339245 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d7c67-6d5c-4370-b454-17362969f2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:28:59.339909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d7c67-6d5c-4370-b454-17362969f2bc service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:28:59.340190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d7c67-6d5c-4370-b454-17362969f2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:28:59.340463 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d7c67-6d5c-4370-b454-17362969f2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:28:59.387680 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:28:59.398251 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d7c67-6d5c-4370-b454-17362969f2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:28:59.399721 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d7c67-6d5c-4370-b454-17362969f2bc service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:28:59.408640 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1410/2789] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:28:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:03.404861 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58847ab-6f1f-4e14-898d-a66799e349dc service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:03.467444 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58847ab-6f1f-4e14-898d-a66799e349dc service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:03.472036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:03.472903 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:03.473190 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:03.473471 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] PATH_INFO: `/v3/users/18028849e04849029ca558c3e15fb481` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:03.474649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18028849e04849029ca558c3e15fb481)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:03.476593 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:03.523604 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18028849e04849029ca558c3e15fb481'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:03.524196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18028849e04849029ca558c3e15fb481'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:03.531000 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18028849e04849029ca558c3e15fb481'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:03.531639 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18028849e04849029ca558c3e15fb481'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:03.538565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18028849e04849029ca558c3e15fb481'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:03.551783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:03.556827 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1380/2790] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:29:03 2022] DELETE /identity/v3/users/18028849e04849029ca558c3e15fb481 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:03.562235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e856cd-a0e3-40db-b38b-c695068ba867 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:03.562731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e856cd-a0e3-40db-b38b-c695068ba867 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:03.562836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e856cd-a0e3-40db-b38b-c695068ba867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:03.580028 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c4e856cd-a0e3-40db-b38b-c695068ba867 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:03.581234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c4e856cd-a0e3-40db-b38b-c695068ba867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:03.639684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1411/2791] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:03.649174 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:03.650622 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:03.711730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e135-69ea-468a-b895-28996c00cf56 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:03.715734 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a24e-bf04-4498-8fee-071f1a27307e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:03.716388 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a24e-bf04-4498-8fee-071f1a27307e service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:03.716677 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a24e-bf04-4498-8fee-071f1a27307e service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:03.716952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a24e-bf04-4498-8fee-071f1a27307e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:03.726951 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305a24e-bf04-4498-8fee-071f1a27307e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:03.728522 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305a24e-bf04-4498-8fee-071f1a27307e service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:03.739034 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1381/2792] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:04.003789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e856cd-a0e3-40db-b38b-c695068ba867 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:04.005263 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c4e856cd-a0e3-40db-b38b-c695068ba867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:04.024077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e856cd-a0e3-40db-b38b-c695068ba867 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:04.031153 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:04.032062 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:04.032345 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:04.032634 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] PATH_INFO: `/v3/projects/c3a5542937a2471eaa2ba88881b994b7` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:04.033806 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a5542937a2471eaa2ba88881b994b7)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:04.035754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:04.082667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a5542937a2471eaa2ba88881b994b7', 'request_id': 'req-27d7ee31-5694-4629-85de-19886ae3b3b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.089414 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a5542937a2471eaa2ba88881b994b7', 'request_id': 'req-27d7ee31-5694-4629-85de-19886ae3b3b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.095222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a5542937a2471eaa2ba88881b994b7', 'request_id': 'req-27d7ee31-5694-4629-85de-19886ae3b3b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.106596 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] The token cache is being invalidate because project c3a5542937a2471eaa2ba88881b994b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:29:04.106885 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.107551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.109098 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1412/2793] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:29:04 2022] DELETE /identity/v3/projects/c3a5542937a2471eaa2ba88881b994b7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:04.113161 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a24e-bf04-4498-8fee-071f1a27307e service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:04.123474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a24e-bf04-4498-8fee-071f1a27307e service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:04.178794 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:04.179889 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:04.180103 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:04.180381 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] PATH_INFO: `/v3/users/ef0de1f3c8264920a2cfb7796b63381b` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:04.181644 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0de1f3c8264920a2cfb7796b63381b)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:04.184150 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:04.233741 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0de1f3c8264920a2cfb7796b63381b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.234496 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0de1f3c8264920a2cfb7796b63381b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.241753 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0de1f3c8264920a2cfb7796b63381b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.242402 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0de1f3c8264920a2cfb7796b63381b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.250430 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-4e9eeb3b-dbce-4602-b786-92dee8982ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0de1f3c8264920a2cfb7796b63381b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.268588 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1382/2794] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:29:04 2022] DELETE /identity/v3/users/ef0de1f3c8264920a2cfb7796b63381b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:04.619583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:04.621144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:04.641767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7ee31-5694-4629-85de-19886ae3b3b5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:04.703238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:04.704158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:04.704445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:04.704722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] PATH_INFO: `/v3/projects/0c8214af4fa041578c4bb6710dacfbe2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:04.705975 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8214af4fa041578c4bb6710dacfbe2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:04.707953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:04.725733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:04.759854 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8214af4fa041578c4bb6710dacfbe2', 'request_id': 'req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.768088 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8214af4fa041578c4bb6710dacfbe2', 'request_id': 'req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.774352 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8214af4fa041578c4bb6710dacfbe2', 'request_id': 'req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.786566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] The token cache is being invalidate because project 0c8214af4fa041578c4bb6710dacfbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:29:04.786856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.787571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4dc612b2-e9ee-4a5f-9495-c9b152fbd68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:04.789366 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1413/2795] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:29:04 2022] DELETE /identity/v3/projects/0c8214af4fa041578c4bb6710dacfbe2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:04.794383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3d94e-2b99-4750-8400-1bd25e718c71 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:04.794927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3d94e-2b99-4750-8400-1bd25e718c71 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:04.795035 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3d94e-2b99-4750-8400-1bd25e718c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:04.813615 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-01d3d94e-2b99-4750-8400-1bd25e718c71 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:04.814850 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-01d3d94e-2b99-4750-8400-1bd25e718c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:04.835714 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:04.887547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1383/2796] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:04.895257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834d228-031e-4914-ba2b-683dcf0f07f7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:04.895600 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834d228-031e-4914-ba2b-683dcf0f07f7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:04.895883 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834d228-031e-4914-ba2b-683dcf0f07f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:04.915218 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c834d228-031e-4914-ba2b-683dcf0f07f7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:04.916497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c834d228-031e-4914-ba2b-683dcf0f07f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:04.924705 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1414/2797] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:04.928900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3d94e-2b99-4750-8400-1bd25e718c71 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:04.939635 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3d94e-2b99-4750-8400-1bd25e718c71 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:04.944270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49928e-3f58-47eb-a6cf-019458605e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:04.944918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49928e-3f58-47eb-a6cf-019458605e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:04.945200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49928e-3f58-47eb-a6cf-019458605e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:04.945477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49928e-3f58-47eb-a6cf-019458605e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:04.946314 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49928e-3f58-47eb-a6cf-019458605e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:29:04.946617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49928e-3f58-47eb-a6cf-019458605e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:04.948912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49928e-3f58-47eb-a6cf-019458605e33 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:04.960538 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1384/2798] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:29:04.964977 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834d228-031e-4914-ba2b-683dcf0f07f7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:04.974154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834d228-031e-4914-ba2b-683dcf0f07f7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:04.978922 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714ed42-81e0-4288-bebd-7f3f8606919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:04.979601 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714ed42-81e0-4288-bebd-7f3f8606919e admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:04.979892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714ed42-81e0-4288-bebd-7f3f8606919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:04.980169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714ed42-81e0-4288-bebd-7f3f8606919e admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:04.980858 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714ed42-81e0-4288-bebd-7f3f8606919e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:04.982731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714ed42-81e0-4288-bebd-7f3f8606919e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.008820 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1415/2799] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:29:04 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:29:05.013596 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49928e-3f58-47eb-a6cf-019458605e33 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.024465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49928e-3f58-47eb-a6cf-019458605e33 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.083498 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8300ad-4b80-49fc-b96c-38e74619969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.084183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8300ad-4b80-49fc-b96c-38e74619969c admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.084470 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8300ad-4b80-49fc-b96c-38e74619969c admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.084749 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8300ad-4b80-49fc-b96c-38e74619969c admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.085450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8300ad-4b80-49fc-b96c-38e74619969c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.087417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8300ad-4b80-49fc-b96c-38e74619969c admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.110131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1385/2800] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:29:05 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:29:05.114343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714ed42-81e0-4288-bebd-7f3f8606919e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.125508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714ed42-81e0-4288-bebd-7f3f8606919e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.130174 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27169aae-bbf0-49f8-a71d-ff6d5046dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.130847 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27169aae-bbf0-49f8-a71d-ff6d5046dd52 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.131133 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27169aae-bbf0-49f8-a71d-ff6d5046dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.131444 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27169aae-bbf0-49f8-a71d-ff6d5046dd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.132182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27169aae-bbf0-49f8-a71d-ff6d5046dd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.133800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27169aae-bbf0-49f8-a71d-ff6d5046dd52 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.148837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1416/2801] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:29:05.152713 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8300ad-4b80-49fc-b96c-38e74619969c admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.165098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8300ad-4b80-49fc-b96c-38e74619969c admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.170649 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5abc-cb95-4222-a939-6599d124e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.171328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5abc-cb95-4222-a939-6599d124e1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.171704 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5abc-cb95-4222-a939-6599d124e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.171979 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5abc-cb95-4222-a939-6599d124e1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.172716 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef5abc-cb95-4222-a939-6599d124e1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.174309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef5abc-cb95-4222-a939-6599d124e1c6 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.185874 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1386/2802] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:29:05.189902 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27169aae-bbf0-49f8-a71d-ff6d5046dd52 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.200918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27169aae-bbf0-49f8-a71d-ff6d5046dd52 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.205862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b96563-e29d-4176-97c8-7fa1125d9292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.206752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b96563-e29d-4176-97c8-7fa1125d9292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.207041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b96563-e29d-4176-97c8-7fa1125d9292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.207317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b96563-e29d-4176-97c8-7fa1125d9292 admin admin] PATH_INFO: `/v3/projects/482b8ae2342a48ab88cf79625af6b5b6/users/889ab6aaa15e44aaaf8bf9fbf3a6d3fb/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.224119 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b96563-e29d-4176-97c8-7fa1125d9292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482b8ae2342a48ab88cf79625af6b5b6, user_id=889ab6aaa15e44aaaf8bf9fbf3a6d3fb, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.226954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b96563-e29d-4176-97c8-7fa1125d9292 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.240762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1417/2803] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:29:05 2022] PUT /identity/v3/projects/482b8ae2342a48ab88cf79625af6b5b6/users/889ab6aaa15e44aaaf8bf9fbf3a6d3fb/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:05.252004 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6262-11d0-4ae3-85b3-bb241c0c94f8 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.252300 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6262-11d0-4ae3-85b3-bb241c0c94f8 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.252587 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6262-11d0-4ae3-85b3-bb241c0c94f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.280384 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-1b7d6262-11d0-4ae3-85b3-bb241c0c94f8 None None] MFA Rules not processed for user `889ab6aaa15e44aaaf8bf9fbf3a6d3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:05.281605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-1b7d6262-11d0-4ae3-85b3-bb241c0c94f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:05.345071 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1387/2804] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:05.349566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b96563-e29d-4176-97c8-7fa1125d9292 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.413483 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b96563-e29d-4176-97c8-7fa1125d9292 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.418945 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcdf49-4f71-4c20-92e2-28b66f4e1757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.419639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcdf49-4f71-4c20-92e2-28b66f4e1757 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.419927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcdf49-4f71-4c20-92e2-28b66f4e1757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.420302 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcdf49-4f71-4c20-92e2-28b66f4e1757 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.420893 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdcdf49-4f71-4c20-92e2-28b66f4e1757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.422920 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdcdf49-4f71-4c20-92e2-28b66f4e1757 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.452722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1418/2805] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:29:05 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:29:05.454142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d6262-11d0-4ae3-85b3-bb241c0c94f8 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.465851 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d6262-11d0-4ae3-85b3-bb241c0c94f8 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.478325 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:05.525406 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb4a36-dd8d-45ac-a444-b98817bae271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.526705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb4a36-dd8d-45ac-a444-b98817bae271 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.526993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb4a36-dd8d-45ac-a444-b98817bae271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.527270 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb4a36-dd8d-45ac-a444-b98817bae271 admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.528033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb4a36-dd8d-45ac-a444-b98817bae271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.529920 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb4a36-dd8d-45ac-a444-b98817bae271 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.550617 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1388/2806] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:29:05 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:29:05.555032 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcdf49-4f71-4c20-92e2-28b66f4e1757 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.566554 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcdf49-4f71-4c20-92e2-28b66f4e1757 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.571250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d077d-1e5e-42f0-9220-e218bdb2cd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.571949 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d077d-1e5e-42f0-9220-e218bdb2cd7d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.572234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d077d-1e5e-42f0-9220-e218bdb2cd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.572513 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d077d-1e5e-42f0-9220-e218bdb2cd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.573329 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d077d-1e5e-42f0-9220-e218bdb2cd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.574929 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d077d-1e5e-42f0-9220-e218bdb2cd7d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.585756 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1419/2807] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:29:05.590049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb4a36-dd8d-45ac-a444-b98817bae271 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.600057 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb4a36-dd8d-45ac-a444-b98817bae271 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.605391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325b046-ead5-4a04-9f8a-4d6cff14a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.606259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325b046-ead5-4a04-9f8a-4d6cff14a0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.606542 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325b046-ead5-4a04-9f8a-4d6cff14a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.606816 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325b046-ead5-4a04-9f8a-4d6cff14a0dc admin admin] PATH_INFO: `/v3/projects/5a1b0f9d88ed4786b7134385f57ef793/users/d63f801ddeb6407c8e3ae29e30359502/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.624927 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325b046-ead5-4a04-9f8a-4d6cff14a0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1b0f9d88ed4786b7134385f57ef793, user_id=d63f801ddeb6407c8e3ae29e30359502, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.627831 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325b046-ead5-4a04-9f8a-4d6cff14a0dc admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.641166 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1389/2808] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:29:05 2022] PUT /identity/v3/projects/5a1b0f9d88ed4786b7134385f57ef793/users/d63f801ddeb6407c8e3ae29e30359502/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:05.645127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d077d-1e5e-42f0-9220-e218bdb2cd7d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.655547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d077d-1e5e-42f0-9220-e218bdb2cd7d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.665910 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:05.717087 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde435dc-26c0-4e08-a352-6ff1aea55eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.717762 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde435dc-26c0-4e08-a352-6ff1aea55eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.718077 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde435dc-26c0-4e08-a352-6ff1aea55eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.718356 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde435dc-26c0-4e08-a352-6ff1aea55eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.719144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde435dc-26c0-4e08-a352-6ff1aea55eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.720895 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde435dc-26c0-4e08-a352-6ff1aea55eb0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.731408 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1420/2809] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:29:05.735676 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325b046-ead5-4a04-9f8a-4d6cff14a0dc admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.745976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325b046-ead5-4a04-9f8a-4d6cff14a0dc admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.750544 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e4453-8778-40ef-83de-4e463d2a53e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.751447 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e4453-8778-40ef-83de-4e463d2a53e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.751732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e4453-8778-40ef-83de-4e463d2a53e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.752006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e4453-8778-40ef-83de-4e463d2a53e2 admin admin] PATH_INFO: `/v3/projects/5a1b0f9d88ed4786b7134385f57ef793/users/d63f801ddeb6407c8e3ae29e30359502/roles/c6577847f998435991dac5744a94d0ee` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.753953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e4453-8778-40ef-83de-4e463d2a53e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1b0f9d88ed4786b7134385f57ef793, user_id=d63f801ddeb6407c8e3ae29e30359502, role_id=c6577847f998435991dac5744a94d0ee)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:05.756643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e4453-8778-40ef-83de-4e463d2a53e2 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:05.766653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1390/2810] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:29:05 2022] PUT /identity/v3/projects/5a1b0f9d88ed4786b7134385f57ef793/users/d63f801ddeb6407c8e3ae29e30359502/roles/c6577847f998435991dac5744a94d0ee => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:05.778246 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ab1ac-50cd-4b11-94aa-0c3aef6053dc None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.778538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ab1ac-50cd-4b11-94aa-0c3aef6053dc None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.778813 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ab1ac-50cd-4b11-94aa-0c3aef6053dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:05.805394 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a24ab1ac-50cd-4b11-94aa-0c3aef6053dc None None] MFA Rules not processed for user `d63f801ddeb6407c8e3ae29e30359502`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:05.806652 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a24ab1ac-50cd-4b11-94aa-0c3aef6053dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:05.874566 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1421/2811] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:29:05.885183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e4453-8778-40ef-83de-4e463d2a53e2 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:05.886912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-bb8e4453-8778-40ef-83de-4e463d2a53e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:05.943994 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e4453-8778-40ef-83de-4e463d2a53e2 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:05.947599 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84267f8a-2a9f-43fc-b29d-d417239d884e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:05.948248 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84267f8a-2a9f-43fc-b29d-d417239d884e service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:05.948556 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84267f8a-2a9f-43fc-b29d-d417239d884e service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:05.948832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84267f8a-2a9f-43fc-b29d-d417239d884e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:06.003705 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84267f8a-2a9f-43fc-b29d-d417239d884e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:06.005128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84267f8a-2a9f-43fc-b29d-d417239d884e service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:06.013952 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1391/2812] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:06.576784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5536e-954f-41c7-8e3a-b9299903eff1 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:06.577079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5536e-954f-41c7-8e3a-b9299903eff1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:06.577363 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5536e-954f-41c7-8e3a-b9299903eff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:06.595415 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-29b5536e-954f-41c7-8e3a-b9299903eff1 None None] MFA Rules not processed for user `e7537024ebe54ceabad7af317f3f977b`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:06.596625 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-29b5536e-954f-41c7-8e3a-b9299903eff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:06.651861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1422/2813] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:10.190239 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84267f8a-2a9f-43fc-b29d-d417239d884e service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:10.191720 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-84267f8a-2a9f-43fc-b29d-d417239d884e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:10.203510 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84267f8a-2a9f-43fc-b29d-d417239d884e service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:10.207144 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e875ef8-87cd-430c-8144-25e6cb2583b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:10.207809 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e875ef8-87cd-430c-8144-25e6cb2583b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:10.208095 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e875ef8-87cd-430c-8144-25e6cb2583b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:10.208370 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e875ef8-87cd-430c-8144-25e6cb2583b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:10.217521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e875ef8-87cd-430c-8144-25e6cb2583b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:10.218939 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e875ef8-87cd-430c-8144-25e6cb2583b2 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:10.228224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1392/2814] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:15.074994 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5536e-954f-41c7-8e3a-b9299903eff1 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:15.116604 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:15.137346 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5536e-954f-41c7-8e3a-b9299903eff1 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:15.141894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:15.142755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:15.143041 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:15.143317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] PATH_INFO: `/v3/users/889ab6aaa15e44aaaf8bf9fbf3a6d3fb` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:15.144524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=889ab6aaa15e44aaaf8bf9fbf3a6d3fb)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:15.146417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:15.192452 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889ab6aaa15e44aaaf8bf9fbf3a6d3fb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.199259 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889ab6aaa15e44aaaf8bf9fbf3a6d3fb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.199944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889ab6aaa15e44aaaf8bf9fbf3a6d3fb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.207369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889ab6aaa15e44aaaf8bf9fbf3a6d3fb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.219265 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889ab6aaa15e44aaaf8bf9fbf3a6d3fb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.225237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1423/2815] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:29:15 2022] DELETE /identity/v3/users/889ab6aaa15e44aaaf8bf9fbf3a6d3fb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:15.230353 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7be12-fa30-4d24-8863-893dee93c6e0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:15.230838 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7be12-fa30-4d24-8863-893dee93c6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:15.230959 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7be12-fa30-4d24-8863-893dee93c6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:15.257862 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-eea7be12-fa30-4d24-8863-893dee93c6e0 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:15.258006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eea7be12-fa30-4d24-8863-893dee93c6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:15.263232 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:15.320977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1393/2816] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:15.330776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:15.332338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:15.391271 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dbd37-41ff-4448-aa01-d5e67e023dd6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:15.402894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a2d6-421f-4157-8b06-ca068f94e0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:15.402894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a2d6-421f-4157-8b06-ca068f94e0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:15.402894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a2d6-421f-4157-8b06-ca068f94e0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:15.402894 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a2d6-421f-4157-8b06-ca068f94e0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:15.406258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a2d6-421f-4157-8b06-ca068f94e0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:15.407741 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a2d6-421f-4157-8b06-ca068f94e0f0 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:15.418154 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1424/2817] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:15.677806 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7be12-fa30-4d24-8863-893dee93c6e0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:15.679374 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eea7be12-fa30-4d24-8863-893dee93c6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:15.692541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7be12-fa30-4d24-8863-893dee93c6e0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:15.697142 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:15.698013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:15.698298 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:15.698576 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] PATH_INFO: `/v3/projects/482b8ae2342a48ab88cf79625af6b5b6` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:15.699795 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482b8ae2342a48ab88cf79625af6b5b6)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:15.701703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:15.748904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482b8ae2342a48ab88cf79625af6b5b6', 'request_id': 'req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.754919 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482b8ae2342a48ab88cf79625af6b5b6', 'request_id': 'req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.761908 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482b8ae2342a48ab88cf79625af6b5b6', 'request_id': 'req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.771992 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] The token cache is being invalidate because project 482b8ae2342a48ab88cf79625af6b5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:29:15.772271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.772894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.774428 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1394/2818] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:29:15 2022] DELETE /identity/v3/projects/482b8ae2342a48ab88cf79625af6b5b6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:15.778905 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a2d6-421f-4157-8b06-ca068f94e0f0 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:15.788627 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a2d6-421f-4157-8b06-ca068f94e0f0 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:15.845480 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:15.846281 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:15.846567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:15.846851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] PATH_INFO: `/v3/users/d63f801ddeb6407c8e3ae29e30359502` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:15.848018 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63f801ddeb6407c8e3ae29e30359502)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:15.849961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:15.852319 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:15.898808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63f801ddeb6407c8e3ae29e30359502'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.906197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63f801ddeb6407c8e3ae29e30359502'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.906865 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63f801ddeb6407c8e3ae29e30359502'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.913860 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63f801ddeb6407c8e3ae29e30359502'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.925666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9e2f682c-45e6-4954-91cf-6053f5334696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63f801ddeb6407c8e3ae29e30359502'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:15.931891 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1425/2819] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:29:15 2022] DELETE /identity/v3/users/d63f801ddeb6407c8e3ae29e30359502 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:29:16.201490 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:16.202918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:16.216203 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ad0f6-e3f2-4dc2-9c62-8332ab3e7264 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:16.274796 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:16.275731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.276019 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.276295 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] PATH_INFO: `/v3/projects/5a1b0f9d88ed4786b7134385f57ef793` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.277571 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1b0f9d88ed4786b7134385f57ef793)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:16.279519 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:16.318039 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:16.330781 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1b0f9d88ed4786b7134385f57ef793', 'request_id': 'req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:16.337187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1b0f9d88ed4786b7134385f57ef793', 'request_id': 'req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:16.344963 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1b0f9d88ed4786b7134385f57ef793', 'request_id': 'req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:16.356001 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] The token cache is being invalidate because project 5a1b0f9d88ed4786b7134385f57ef793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:29:16.356286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:16.356926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-8dcb6049-0ab0-47f5-a567-5b2c944a7c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:16.359022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1395/2820] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:29:16 2022] DELETE /identity/v3/projects/5a1b0f9d88ed4786b7134385f57ef793 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:16.365859 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31549ea9-d045-48f2-956d-5ec7da4f674a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.366369 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31549ea9-d045-48f2-956d-5ec7da4f674a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.366494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31549ea9-d045-48f2-956d-5ec7da4f674a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.386395 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-31549ea9-d045-48f2-956d-5ec7da4f674a None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:16.387583 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-31549ea9-d045-48f2-956d-5ec7da4f674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:16.455101 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1426/2821] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:16.463761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2715a-76e0-4747-a700-1cdeaa674766 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.464051 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2715a-76e0-4747-a700-1cdeaa674766 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.464328 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2715a-76e0-4747-a700-1cdeaa674766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.484477 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-78e2715a-76e0-4747-a700-1cdeaa674766 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:16.485754 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-78e2715a-76e0-4747-a700-1cdeaa674766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:16.495569 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1396/2822] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:16.499840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31549ea9-d045-48f2-956d-5ec7da4f674a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:16.509747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31549ea9-d045-48f2-956d-5ec7da4f674a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:16.514377 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece96b2-2b62-479f-9853-fd7e2fd2cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:16.515034 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece96b2-2b62-479f-9853-fd7e2fd2cdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.515321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece96b2-2b62-479f-9853-fd7e2fd2cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.515639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece96b2-2b62-479f-9853-fd7e2fd2cdd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.516375 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece96b2-2b62-479f-9853-fd7e2fd2cdd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:29:16.516682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece96b2-2b62-479f-9853-fd7e2fd2cdd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:16.518303 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece96b2-2b62-479f-9853-fd7e2fd2cdd7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:16.533666 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1427/2823] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 07 14:29:16.535041 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2715a-76e0-4747-a700-1cdeaa674766 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:16.545559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2715a-76e0-4747-a700-1cdeaa674766 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:16.550196 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070ac7-6cc2-4b93-94ba-757023dc907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:16.550833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070ac7-6cc2-4b93-94ba-757023dc907e admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.551120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070ac7-6cc2-4b93-94ba-757023dc907e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.551423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070ac7-6cc2-4b93-94ba-757023dc907e admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.552108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c070ac7-6cc2-4b93-94ba-757023dc907e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:16.553986 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c070ac7-6cc2-4b93-94ba-757023dc907e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:16.585140 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1397/2824] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:29:16 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:29:16.590052 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece96b2-2b62-479f-9853-fd7e2fd2cdd7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:16.600148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece96b2-2b62-479f-9853-fd7e2fd2cdd7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:16.658044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6780-223f-4067-857a-6bce366adfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:16.658670 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6780-223f-4067-857a-6bce366adfc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.658955 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6780-223f-4067-857a-6bce366adfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.659234 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e6780-223f-4067-857a-6bce366adfc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.659973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e6780-223f-4067-857a-6bce366adfc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:16.661941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e6780-223f-4067-857a-6bce366adfc5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:16.675687 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:16.681976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1428/2825] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:29:16 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:29:16.686901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070ac7-6cc2-4b93-94ba-757023dc907e admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:16.697974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070ac7-6cc2-4b93-94ba-757023dc907e admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:16.703014 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19040f-2ca1-48b3-a474-4d01d412650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:16.703813 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19040f-2ca1-48b3-a474-4d01d412650e admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.704824 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19040f-2ca1-48b3-a474-4d01d412650e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.705110 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19040f-2ca1-48b3-a474-4d01d412650e admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.706048 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19040f-2ca1-48b3-a474-4d01d412650e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:16.707673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19040f-2ca1-48b3-a474-4d01d412650e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:16.724868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1398/2826] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:29:16.728135 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6780-223f-4067-857a-6bce366adfc5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:16.738586 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e6780-223f-4067-857a-6bce366adfc5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:16.743523 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d94d70-95be-4844-9e3f-80aeff351376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:16.744210 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d94d70-95be-4844-9e3f-80aeff351376 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.744494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d94d70-95be-4844-9e3f-80aeff351376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.744768 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d94d70-95be-4844-9e3f-80aeff351376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.745494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d94d70-95be-4844-9e3f-80aeff351376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:16.747061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d94d70-95be-4844-9e3f-80aeff351376 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:16.761934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1429/2827] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:29:16.763980 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19040f-2ca1-48b3-a474-4d01d412650e admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:16.774288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19040f-2ca1-48b3-a474-4d01d412650e admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:16.779550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648d6e-e8ac-4131-b675-33702746c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:16.780431 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648d6e-e8ac-4131-b675-33702746c289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.780710 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648d6e-e8ac-4131-b675-33702746c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.780983 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648d6e-e8ac-4131-b675-33702746c289 admin admin] PATH_INFO: `/v3/projects/0253996335444d05a15ea351102db54e/users/e592b91a94274a30916232335eee475f/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.796011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10648d6e-e8ac-4131-b675-33702746c289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0253996335444d05a15ea351102db54e, user_id=e592b91a94274a30916232335eee475f, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:16.798653 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10648d6e-e8ac-4131-b675-33702746c289 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:16.812833 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1399/2828] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:29:16 2022] PUT /identity/v3/projects/0253996335444d05a15ea351102db54e/users/e592b91a94274a30916232335eee475f/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:16.879547 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a9eb8-e6d2-4fda-b86a-649f6c6b9996 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:16.879836 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a9eb8-e6d2-4fda-b86a-649f6c6b9996 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:16.880157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a9eb8-e6d2-4fda-b86a-649f6c6b9996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:16.908113 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e38a9eb8-e6d2-4fda-b86a-649f6c6b9996 None None] MFA Rules not processed for user `e592b91a94274a30916232335eee475f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:16.909260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e38a9eb8-e6d2-4fda-b86a-649f6c6b9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:16.977850 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1430/2829] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:16.987033 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648d6e-e8ac-4131-b675-33702746c289 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:16.988743 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-10648d6e-e8ac-4131-b675-33702746c289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:17.046309 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648d6e-e8ac-4131-b675-33702746c289 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:17.050261 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b44c1-5196-4b3e-b30d-6546bb45dd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:17.050934 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b44c1-5196-4b3e-b30d-6546bb45dd4a service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:17.051180 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b44c1-5196-4b3e-b30d-6546bb45dd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:17.051488 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b44c1-5196-4b3e-b30d-6546bb45dd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:17.060968 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b44c1-5196-4b3e-b30d-6546bb45dd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:17.062391 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b44c1-5196-4b3e-b30d-6546bb45dd4a service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:17.071610 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1400/2830] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:22.029776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80839d4-aaaf-43cb-8ded-e1f51a177ef5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:22.030256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80839d4-aaaf-43cb-8ded-e1f51a177ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:22.030529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80839d4-aaaf-43cb-8ded-e1f51a177ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:22.048350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c80839d4-aaaf-43cb-8ded-e1f51a177ef5 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:22.054261 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c80839d4-aaaf-43cb-8ded-e1f51a177ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:22.107076 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1431/2831] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:29:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:22.157718 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b44c1-5196-4b3e-b30d-6546bb45dd4a service cinder] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:22.159229 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-d23b44c1-5196-4b3e-b30d-6546bb45dd4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:22.229565 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b44c1-5196-4b3e-b30d-6546bb45dd4a service cinder] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:22.234521 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317480b0-75f4-4aba-9749-8999ef6f440e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:22.235231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317480b0-75f4-4aba-9749-8999ef6f440e service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:22.235601 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317480b0-75f4-4aba-9749-8999ef6f440e service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:22.235885 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317480b0-75f4-4aba-9749-8999ef6f440e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:22.240947 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:22.246053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317480b0-75f4-4aba-9749-8999ef6f440e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:22.248037 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317480b0-75f4-4aba-9749-8999ef6f440e service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:22.257385 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1401/2832] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:29:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:29:27.000682 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80839d4-aaaf-43cb-8ded-e1f51a177ef5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:27.072623 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80839d4-aaaf-43cb-8ded-e1f51a177ef5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:27.077987 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:27.078993 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:27.079432 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:27.079611 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] PATH_INFO: `/v3/users/e592b91a94274a30916232335eee475f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:27.080851 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e592b91a94274a30916232335eee475f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:27.083127 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:27.107840 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:27.144562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e592b91a94274a30916232335eee475f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.155402 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e592b91a94274a30916232335eee475f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.156416 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e592b91a94274a30916232335eee475f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.164998 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e592b91a94274a30916232335eee475f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.179590 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e592b91a94274a30916232335eee475f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.186752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1432/2833] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:29:26 2022] DELETE /identity/v3/users/e592b91a94274a30916232335eee475f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:29:27.191277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92f7b8-45c4-4458-a964-84ed0613983d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:27.191805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92f7b8-45c4-4458-a964-84ed0613983d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:27.191918 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92f7b8-45c4-4458-a964-84ed0613983d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:27.212014 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-be92f7b8-45c4-4458-a964-84ed0613983d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:27.213778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-be92f7b8-45c4-4458-a964-84ed0613983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:27.284450 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1402/2834] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:27.297898 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:27.299571 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:27.366148 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241172ab-0f97-4291-b357-832dbdfec621 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:27.372258 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fc594-1bd2-4b49-b1b4-2c3e99e47bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:27.373159 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc594-1bd2-4b49-b1b4-2c3e99e47bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:27.373445 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc594-1bd2-4b49-b1b4-2c3e99e47bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:27.373771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc594-1bd2-4b49-b1b4-2c3e99e47bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:27.387376 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fc594-1bd2-4b49-b1b4-2c3e99e47bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:27.388944 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87fc594-1bd2-4b49-b1b4-2c3e99e47bd2 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:27.400315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1433/2835] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:27.732820 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92f7b8-45c4-4458-a964-84ed0613983d None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:27.734228 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-be92f7b8-45c4-4458-a964-84ed0613983d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:27.765627 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92f7b8-45c4-4458-a964-84ed0613983d None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:27.770728 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:27.771883 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:27.772260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:27.772634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] PATH_INFO: `/v3/projects/0253996335444d05a15ea351102db54e` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:27.774073 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0253996335444d05a15ea351102db54e)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:27.776485 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:27.836341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0253996335444d05a15ea351102db54e', 'request_id': 'req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.843598 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0253996335444d05a15ea351102db54e', 'request_id': 'req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.855847 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0253996335444d05a15ea351102db54e', 'request_id': 'req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.870440 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] The token cache is being invalidate because project 0253996335444d05a15ea351102db54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:29:27.870689 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.871367 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f3d506c2-4eb8-445e-aadf-3fae7a08fe60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:27.876383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1403/2836] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:29:27 2022] DELETE /identity/v3/projects/0253996335444d05a15ea351102db54e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:27.878190 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e42c-998a-4046-b0d1-768d1e7ab566 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:27.878667 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e42c-998a-4046-b0d1-768d1e7ab566 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:27.879120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847e42c-998a-4046-b0d1-768d1e7ab566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:27.898331 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c847e42c-998a-4046-b0d1-768d1e7ab566 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:27.899837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c847e42c-998a-4046-b0d1-768d1e7ab566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:27.977001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1434/2837] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:27.979305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a20e4-809c-42c7-b9f6-504005c2e131 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:27.979641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a20e4-809c-42c7-b9f6-504005c2e131 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:27.979917 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a20e4-809c-42c7-b9f6-504005c2e131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:28.006215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-4c1a20e4-809c-42c7-b9f6-504005c2e131 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:28.007489 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4c1a20e4-809c-42c7-b9f6-504005c2e131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:28.021383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1404/2838] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:28.022587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847e42c-998a-4046-b0d1-768d1e7ab566 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:28.033731 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847e42c-998a-4046-b0d1-768d1e7ab566 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:28.041304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0748e-b83a-4758-b86d-f914f461cb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:28.042022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0748e-b83a-4758-b86d-f914f461cb43 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:28.042435 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0748e-b83a-4758-b86d-f914f461cb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:28.042722 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0748e-b83a-4758-b86d-f914f461cb43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:28.043510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0748e-b83a-4758-b86d-f914f461cb43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:29:28.043829 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0748e-b83a-4758-b86d-f914f461cb43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:28.045494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0748e-b83a-4758-b86d-f914f461cb43 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:28.059984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1435/2839] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:29:28.064438 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a20e4-809c-42c7-b9f6-504005c2e131 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:28.078351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a20e4-809c-42c7-b9f6-504005c2e131 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:28.084348 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75ab57-7f40-42b7-a609-0531fda45f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:28.085513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75ab57-7f40-42b7-a609-0531fda45f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:28.085905 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75ab57-7f40-42b7-a609-0531fda45f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:28.086290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75ab57-7f40-42b7-a609-0531fda45f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:28.087286 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75ab57-7f40-42b7-a609-0531fda45f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:28.089215 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75ab57-7f40-42b7-a609-0531fda45f24 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:28.117224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1405/2840] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:29:28 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:29:28.121879 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0748e-b83a-4758-b86d-f914f461cb43 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:28.133279 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0748e-b83a-4758-b86d-f914f461cb43 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:28.171538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:28.214642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b25d1-aaf1-4420-b1df-bd20e1dad2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:28.215397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b25d1-aaf1-4420-b1df-bd20e1dad2ee admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:28.215749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b25d1-aaf1-4420-b1df-bd20e1dad2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:28.216033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b25d1-aaf1-4420-b1df-bd20e1dad2ee admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:28.216755 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b25d1-aaf1-4420-b1df-bd20e1dad2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:28.218688 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b25d1-aaf1-4420-b1df-bd20e1dad2ee admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:28.246973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1436/2841] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:29:28 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 07 14:29:28.251495 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75ab57-7f40-42b7-a609-0531fda45f24 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:28.267761 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75ab57-7f40-42b7-a609-0531fda45f24 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:28.274410 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd83336-727e-4979-91c4-2d64e88adf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:28.276791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd83336-727e-4979-91c4-2d64e88adf8f admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:28.277202 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd83336-727e-4979-91c4-2d64e88adf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:28.277613 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd83336-727e-4979-91c4-2d64e88adf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:28.278671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd83336-727e-4979-91c4-2d64e88adf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:28.280780 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd83336-727e-4979-91c4-2d64e88adf8f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:28.293882 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1406/2842] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:29:28.298120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b25d1-aaf1-4420-b1df-bd20e1dad2ee admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:28.308560 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b25d1-aaf1-4420-b1df-bd20e1dad2ee admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:28.316275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83838e-6aa2-4636-962e-b7b9c8a35a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:28.316946 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83838e-6aa2-4636-962e-b7b9c8a35a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:28.317230 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83838e-6aa2-4636-962e-b7b9c8a35a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:28.317512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83838e-6aa2-4636-962e-b7b9c8a35a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:28.318256 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83838e-6aa2-4636-962e-b7b9c8a35a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:28.319927 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83838e-6aa2-4636-962e-b7b9c8a35a07 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:28.335372 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1437/2843] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:29:28.337687 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd83336-727e-4979-91c4-2d64e88adf8f admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:28.353732 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd83336-727e-4979-91c4-2d64e88adf8f admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:28.359933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4bc5-ec6b-4b19-b03f-189c2c3546dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:28.362255 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4bc5-ec6b-4b19-b03f-189c2c3546dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:28.362771 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4bc5-ec6b-4b19-b03f-189c2c3546dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:28.363222 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4bc5-ec6b-4b19-b03f-189c2c3546dc admin admin] PATH_INFO: `/v3/projects/051558f24d7f41dba8eb52207f4fb84b/users/918cfd9049a542fbb35c4b595dd2ded8/roles/a284a48d48b2440997815469786a10ec` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:28.383651 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d4bc5-ec6b-4b19-b03f-189c2c3546dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=051558f24d7f41dba8eb52207f4fb84b, user_id=918cfd9049a542fbb35c4b595dd2ded8, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:28.387916 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d4bc5-ec6b-4b19-b03f-189c2c3546dc admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:28.405877 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1407/2844] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:29:28 2022] PUT /identity/v3/projects/051558f24d7f41dba8eb52207f4fb84b/users/918cfd9049a542fbb35c4b595dd2ded8/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:28.418128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261e6e8-17d4-402b-86c7-f7887d5bec70 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:28.418507 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261e6e8-17d4-402b-86c7-f7887d5bec70 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:28.418862 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261e6e8-17d4-402b-86c7-f7887d5bec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:28.450351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7261e6e8-17d4-402b-86c7-f7887d5bec70 None None] MFA Rules not processed for user `918cfd9049a542fbb35c4b595dd2ded8`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:28.451510 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7261e6e8-17d4-402b-86c7-f7887d5bec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:28.528229 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1438/2845] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:28.539383 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4bc5-ec6b-4b19-b03f-189c2c3546dc admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:28.542297 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-b98d4bc5-ec6b-4b19-b03f-189c2c3546dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:28.565465 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:28.622845 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4bc5-ec6b-4b19-b03f-189c2c3546dc admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:28.626926 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8ebac-3eb0-4b78-8bc1-b4f8b21ebee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:28.627708 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ebac-3eb0-4b78-8bc1-b4f8b21ebee8 service cinder] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:28.628151 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ebac-3eb0-4b78-8bc1-b4f8b21ebee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:28.628503 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8ebac-3eb0-4b78-8bc1-b4f8b21ebee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:28.638456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ebac-3eb0-4b78-8bc1-b4f8b21ebee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:28.640218 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8ebac-3eb0-4b78-8bc1-b4f8b21ebee8 service cinder] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:28.651065 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1408/2846] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:30.086213 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b8419-d64e-42e4-a1eb-4d2f76d79dda None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:30.086752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b8419-d64e-42e4-a1eb-4d2f76d79dda None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:30.086752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b8419-d64e-42e4-a1eb-4d2f76d79dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:30.108928 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b10b8419-d64e-42e4-a1eb-4d2f76d79dda None None] MFA Rules not processed for user `918cfd9049a542fbb35c4b595dd2ded8`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:30.110209 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b10b8419-d64e-42e4-a1eb-4d2f76d79dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:30.120157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1439/2847] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:37.785424 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef63d5c-d420-495f-aa1c-f036e7d049c6 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:37.785894 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef63d5c-d420-495f-aa1c-f036e7d049c6 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:37.786006 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef63d5c-d420-495f-aa1c-f036e7d049c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:37.803591 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-eef63d5c-d420-495f-aa1c-f036e7d049c6 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:37.804783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eef63d5c-d420-495f-aa1c-f036e7d049c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:37.860348 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1409/2848] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jun 7 14:29:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:37.872582 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b8419-d64e-42e4-a1eb-4d2f76d79dda None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:37.873961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b10b8419-d64e-42e4-a1eb-4d2f76d79dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:37.942771 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b8419-d64e-42e4-a1eb-4d2f76d79dda None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:37.947779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3b38a-0888-4904-80a0-97829db0fb64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:37.948465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3b38a-0888-4904-80a0-97829db0fb64 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:37.948753 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3b38a-0888-4904-80a0-97829db0fb64 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:37.949031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3b38a-0888-4904-80a0-97829db0fb64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:37.957276 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3b38a-0888-4904-80a0-97829db0fb64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:37.958861 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3b38a-0888-4904-80a0-97829db0fb64 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:37.967700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1440/2849] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:29:40.086900 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef63d5c-d420-495f-aa1c-f036e7d049c6 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:40.088417 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-eef63d5c-d420-495f-aa1c-f036e7d049c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:40.153418 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef63d5c-d420-495f-aa1c-f036e7d049c6 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:40.157953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:40.158825 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.159108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.159421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] PATH_INFO: `/v3/users/e7537024ebe54ceabad7af317f3f977b` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.160625 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7537024ebe54ceabad7af317f3f977b)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:40.162525 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:40.207605 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7537024ebe54ceabad7af317f3f977b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.208253 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7537024ebe54ceabad7af317f3f977b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.215243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7537024ebe54ceabad7af317f3f977b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.215970 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7537024ebe54ceabad7af317f3f977b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.223120 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-76b002c6-7099-4921-8cfc-63ced110b6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7537024ebe54ceabad7af317f3f977b'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.224285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:40.243507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1410/2850] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:29:40 2022] DELETE /identity/v3/users/e7537024ebe54ceabad7af317f3f977b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:40.421275 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3b38a-0888-4904-80a0-97829db0fb64 service swift] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:40.432733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3b38a-0888-4904-80a0-97829db0fb64 service swift] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:40.452460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:40.496984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:40.498274 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.498567 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.498869 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] PATH_INFO: `/v3/projects/66eeecc5a4ce4310b1ce1119c146d2e8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.500085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66eeecc5a4ce4310b1ce1119c146d2e8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:40.502112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:40.553502 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66eeecc5a4ce4310b1ce1119c146d2e8', 'request_id': 'req-6d05e00e-1f40-45c5-9861-787812074700'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.561647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66eeecc5a4ce4310b1ce1119c146d2e8', 'request_id': 'req-6d05e00e-1f40-45c5-9861-787812074700'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.567948 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66eeecc5a4ce4310b1ce1119c146d2e8', 'request_id': 'req-6d05e00e-1f40-45c5-9861-787812074700'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.579069 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] The token cache is being invalidate because project 66eeecc5a4ce4310b1ce1119c146d2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:29:40.579381 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.580038 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6d05e00e-1f40-45c5-9861-787812074700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:40.581591 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1441/2851] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:29:40 2022] DELETE /identity/v3/projects/66eeecc5a4ce4310b1ce1119c146d2e8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:40.587637 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005556-c3ec-4d2e-aad5-c477b1554966 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.587929 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005556-c3ec-4d2e-aad5-c477b1554966 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.588209 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005556-c3ec-4d2e-aad5-c477b1554966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.605901 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-0c005556-c3ec-4d2e-aad5-c477b1554966 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:40.607108 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-0c005556-c3ec-4d2e-aad5-c477b1554966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:40.665102 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1411/2852] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:40.672792 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33190d7-402d-4a3e-890f-d80fb0e8a079 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.673089 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33190d7-402d-4a3e-890f-d80fb0e8a079 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.673374 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33190d7-402d-4a3e-890f-d80fb0e8a079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.692338 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e33190d7-402d-4a3e-890f-d80fb0e8a079 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:40.693551 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e33190d7-402d-4a3e-890f-d80fb0e8a079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:40.701497 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1442/2853] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:40.705815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005556-c3ec-4d2e-aad5-c477b1554966 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:40.715731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005556-c3ec-4d2e-aad5-c477b1554966 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:40.720326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0272dd-ded5-4272-bd29-762702e37056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:40.720977 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0272dd-ded5-4272-bd29-762702e37056 admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.721260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0272dd-ded5-4272-bd29-762702e37056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.721532 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0272dd-ded5-4272-bd29-762702e37056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.722260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0272dd-ded5-4272-bd29-762702e37056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80292) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 07 14:29:40.722563 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0272dd-ded5-4272-bd29-762702e37056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:40.724182 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0272dd-ded5-4272-bd29-762702e37056 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:40.736841 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1412/2854] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jun 7 14:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 07 14:29:40.741054 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33190d7-402d-4a3e-890f-d80fb0e8a079 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:40.751061 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33190d7-402d-4a3e-890f-d80fb0e8a079 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:40.756431 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3356db-0d7a-4314-a4b7-85e0322b6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:40.757097 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3356db-0d7a-4314-a4b7-85e0322b6e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.757383 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3356db-0d7a-4314-a4b7-85e0322b6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.757665 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3356db-0d7a-4314-a4b7-85e0322b6e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.758364 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3356db-0d7a-4314-a4b7-85e0322b6e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:40.760343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3356db-0d7a-4314-a4b7-85e0322b6e7f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:40.784803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1443/2855] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jun 7 14:29:40 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:29:40.789068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0272dd-ded5-4272-bd29-762702e37056 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:40.799507 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0272dd-ded5-4272-bd29-762702e37056 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:40.855559 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e0d0-5d1c-4ac3-9d30-fd418f21691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:40.856246 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e0d0-5d1c-4ac3-9d30-fd418f21691a admin admin] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.856533 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e0d0-5d1c-4ac3-9d30-fd418f21691a admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.856812 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e0d0-5d1c-4ac3-9d30-fd418f21691a admin admin] PATH_INFO: `/v3/users` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.857494 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e0d0-5d1c-4ac3-9d30-fd418f21691a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:40.859463 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e0d0-5d1c-4ac3-9d30-fd418f21691a admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:40.878760 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1413/2856] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jun 7 14:29:40 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 07 14:29:40.882870 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3356db-0d7a-4314-a4b7-85e0322b6e7f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:40.892918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3356db-0d7a-4314-a4b7-85e0322b6e7f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:40.897470 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391337ee-36bf-431c-bd80-2a1404913136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:40.898116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391337ee-36bf-431c-bd80-2a1404913136 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.898404 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391337ee-36bf-431c-bd80-2a1404913136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.899182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391337ee-36bf-431c-bd80-2a1404913136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.899941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391337ee-36bf-431c-bd80-2a1404913136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:40.901499 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391337ee-36bf-431c-bd80-2a1404913136 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:40.911966 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1444/2857] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 07 14:29:40.916403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e0d0-5d1c-4ac3-9d30-fd418f21691a admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:40.926393 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e0d0-5d1c-4ac3-9d30-fd418f21691a admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:40.930957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae537598-fbde-48e5-b316-ba5b1c03706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:40.931663 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae537598-fbde-48e5-b316-ba5b1c03706f admin admin] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.931943 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae537598-fbde-48e5-b316-ba5b1c03706f admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.932219 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae537598-fbde-48e5-b316-ba5b1c03706f admin admin] PATH_INFO: `/v3/roles` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.932940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae537598-fbde-48e5-b316-ba5b1c03706f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:40.934766 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae537598-fbde-48e5-b316-ba5b1c03706f admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:40.944531 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1414/2858] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jun 7 14:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 07 14:29:40.948292 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391337ee-36bf-431c-bd80-2a1404913136 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:40.958085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391337ee-36bf-431c-bd80-2a1404913136 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:40.963454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291e500-fe08-434d-8233-96f516fa26f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:40.964326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291e500-fe08-434d-8233-96f516fa26f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:40.964607 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291e500-fe08-434d-8233-96f516fa26f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:40.964876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291e500-fe08-434d-8233-96f516fa26f6 admin admin] PATH_INFO: `/v3/projects/27e7df0e7d8748d793e50140ec5d7137/users/c9d6fb446bed4ac9b756245e2ae2189e/roles/a284a48d48b2440997815469786a10ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:40.979751 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291e500-fe08-434d-8233-96f516fa26f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e7df0e7d8748d793e50140ec5d7137, user_id=c9d6fb446bed4ac9b756245e2ae2189e, role_id=a284a48d48b2440997815469786a10ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:40.982397 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291e500-fe08-434d-8233-96f516fa26f6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:40.996344 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1445/2859] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jun 7 14:29:40 2022] PUT /identity/v3/projects/27e7df0e7d8748d793e50140ec5d7137/users/c9d6fb446bed4ac9b756245e2ae2189e/roles/a284a48d48b2440997815469786a10ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 07 14:29:41.001341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea8594-d401-42cd-ab1e-f562ba29f621 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:41.001641 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea8594-d401-42cd-ab1e-f562ba29f621 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:41.001953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea8594-d401-42cd-ab1e-f562ba29f621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:41.019778 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-91ea8594-d401-42cd-ab1e-f562ba29f621 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:41.020984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-91ea8594-d401-42cd-ab1e-f562ba29f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:41.065131 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:41.083634 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1415/2860] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:41.093614 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291e500-fe08-434d-8233-96f516fa26f6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:41.095260 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7291e500-fe08-434d-8233-96f516fa26f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:41.151697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:41.155684 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291e500-fe08-434d-8233-96f516fa26f6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:41.160304 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f7cd8-f5ce-4c0d-bbd7-c941df27ba24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:41.160986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f7cd8-f5ce-4c0d-bbd7-c941df27ba24 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:41.161339 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f7cd8-f5ce-4c0d-bbd7-c941df27ba24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:41.161782 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f7cd8-f5ce-4c0d-bbd7-c941df27ba24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:41.172022 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f7cd8-f5ce-4c0d-bbd7-c941df27ba24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:41.173448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f7cd8-f5ce-4c0d-bbd7-c941df27ba24 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:41.182808 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1446/2861] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:41.877912 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa214c6-c5bc-4fdd-8588-7318e09b7a23 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:41.878423 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa214c6-c5bc-4fdd-8588-7318e09b7a23 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:41.878606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa214c6-c5bc-4fdd-8588-7318e09b7a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:41.909210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-9aa214c6-c5bc-4fdd-8588-7318e09b7a23 None None] MFA Rules not processed for user `c9d6fb446bed4ac9b756245e2ae2189e`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:41.910368 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-9aa214c6-c5bc-4fdd-8588-7318e09b7a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:41.986285 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1416/2862] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:41.997494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f7cd8-f5ce-4c0d-bbd7-c941df27ba24 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:41.999060 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-db7f7cd8-f5ce-4c0d-bbd7-c941df27ba24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:42.059419 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f7cd8-f5ce-4c0d-bbd7-c941df27ba24 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:42.063116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e607e-6627-4070-9bf5-b4f253a07956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbba49c3d7c24cd699d85fb93c76e7fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:42.063876 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e607e-6627-4070-9bf5-b4f253a07956 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:42.064157 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e607e-6627-4070-9bf5-b4f253a07956 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:42.064546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e607e-6627-4070-9bf5-b4f253a07956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:42.074085 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e607e-6627-4070-9bf5-b4f253a07956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:42.075576 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e607e-6627-4070-9bf5-b4f253a07956 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:42.084555 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1447/2863] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:43.418157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f6d11-0615-4415-bf40-3ba3b28b81c0 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:43.418974 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f6d11-0615-4415-bf40-3ba3b28b81c0 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:43.419287 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f6d11-0615-4415-bf40-3ba3b28b81c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:43.438993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-324f6d11-0615-4415-bf40-3ba3b28b81c0 None None] MFA Rules not processed for user `c9d6fb446bed4ac9b756245e2ae2189e`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:43.440290 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-324f6d11-0615-4415-bf40-3ba3b28b81c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:43.447686 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1417/2864] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:45.450064 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17df64-47c8-4aa5-8b9c-ed89fcc3eef7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:45.450529 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17df64-47c8-4aa5-8b9c-ed89fcc3eef7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:45.450639 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17df64-47c8-4aa5-8b9c-ed89fcc3eef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:45.467866 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ff17df64-47c8-4aa5-8b9c-ed89fcc3eef7 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:45.469086 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ff17df64-47c8-4aa5-8b9c-ed89fcc3eef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:45.532033 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1448/2865] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:29:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:45.544933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f6d11-0615-4415-bf40-3ba3b28b81c0 None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:45.546483 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-324f6d11-0615-4415-bf40-3ba3b28b81c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:45.622109 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f6d11-0615-4415-bf40-3ba3b28b81c0 None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:45.627080 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bf621-6253-4ef1-8d5a-dab191bea440 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:45.627832 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bf621-6253-4ef1-8d5a-dab191bea440 service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:45.628116 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bf621-6253-4ef1-8d5a-dab191bea440 service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:45.628392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bf621-6253-4ef1-8d5a-dab191bea440 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:45.637350 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bf621-6253-4ef1-8d5a-dab191bea440 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:45.639217 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bf621-6253-4ef1-8d5a-dab191bea440 service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:45.647579 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1418/2866] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:29:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:29:46.157000 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab28d54-43a9-4957-89f0-ca3a73b1fc8a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:46.157295 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab28d54-43a9-4957-89f0-ca3a73b1fc8a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:46.157697 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab28d54-43a9-4957-89f0-ca3a73b1fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:46.179238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9ab28d54-43a9-4957-89f0-ca3a73b1fc8a None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:46.180978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9ab28d54-43a9-4957-89f0-ca3a73b1fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:46.189120 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1449/2867] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jun 7 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:29:46.203128 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bf621-6253-4ef1-8d5a-dab191bea440 service swift] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:46.217179 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bf621-6253-4ef1-8d5a-dab191bea440 service swift] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:46.222961 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804e9e-d908-42d1-9358-95dc6f88c296 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:46.223745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804e9e-d908-42d1-9358-95dc6f88c296 service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:46.224098 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804e9e-d908-42d1-9358-95dc6f88c296 service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:46.224537 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804e9e-d908-42d1-9358-95dc6f88c296 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:46.234799 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804e9e-d908-42d1-9358-95dc6f88c296 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:46.236505 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804e9e-d908-42d1-9358-95dc6f88c296 service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:46.245392 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1419/2868] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:29:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:29:46.466677 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b04eb3-1689-44be-b1e7-488850aa2e5b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:46.467155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b04eb3-1689-44be-b1e7-488850aa2e5b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:46.467250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b04eb3-1689-44be-b1e7-488850aa2e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:46.488162 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c8b04eb3-1689-44be-b1e7-488850aa2e5b None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:46.489388 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c8b04eb3-1689-44be-b1e7-488850aa2e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:46.497986 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1450/2869] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jun 7 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:46.510277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804e9e-d908-42d1-9358-95dc6f88c296 service swift] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:46.521082 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804e9e-d908-42d1-9358-95dc6f88c296 service swift] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:46.526221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bef58-2d28-4ada-b7e4-3dd88d760f8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:46.526953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bef58-2d28-4ada-b7e4-3dd88d760f8c service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:46.527243 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bef58-2d28-4ada-b7e4-3dd88d760f8c service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:46.527550 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bef58-2d28-4ada-b7e4-3dd88d760f8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:46.536047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bef58-2d28-4ada-b7e4-3dd88d760f8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:46.542334 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bef58-2d28-4ada-b7e4-3dd88d760f8c service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:46.551455 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1420/2870] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:29:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:29:46.891661 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0474b4c-f56f-456f-81f0-6e963eccb0d8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:46.891953 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0474b4c-f56f-456f-81f0-6e963eccb0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:46.892235 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0474b4c-f56f-456f-81f0-6e963eccb0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:46.910941 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a0474b4c-f56f-456f-81f0-6e963eccb0d8 None None] MFA Rules not processed for user `ff1e9d0a33d54a57af28874b4a57738a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:46.912183 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a0474b4c-f56f-456f-81f0-6e963eccb0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:46.919935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1451/2871] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jun 7 14:29:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:29:46.932118 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bef58-2d28-4ada-b7e4-3dd88d760f8c service swift] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:46.942989 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bef58-2d28-4ada-b7e4-3dd88d760f8c service swift] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:46.948821 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71997bed-bbe4-45e2-8cff-1fee16a2542e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee8475d17d2349559125d2bcd969b9f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:46.949461 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997bed-bbe4-45e2-8cff-1fee16a2542e service swift] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:46.949745 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997bed-bbe4-45e2-8cff-1fee16a2542e service swift] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:46.950020 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71997bed-bbe4-45e2-8cff-1fee16a2542e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:46.958320 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71997bed-bbe4-45e2-8cff-1fee16a2542e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:46.959933 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71997bed-bbe4-45e2-8cff-1fee16a2542e service swift] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:46.969227 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1421/2872] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jun 7 14:29:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 07 14:29:49.004457 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0474b4c-f56f-456f-81f0-6e963eccb0d8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:49.005884 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a0474b4c-f56f-456f-81f0-6e963eccb0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:49.022051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0474b4c-f56f-456f-81f0-6e963eccb0d8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:49.027495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:49.028399 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:49.028681 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:49.028956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] PATH_INFO: `/v3/users/918cfd9049a542fbb35c4b595dd2ded8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:49.030155 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=918cfd9049a542fbb35c4b595dd2ded8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:49.032350 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:49.084837 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918cfd9049a542fbb35c4b595dd2ded8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.093664 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918cfd9049a542fbb35c4b595dd2ded8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.094599 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918cfd9049a542fbb35c4b595dd2ded8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.103575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918cfd9049a542fbb35c4b595dd2ded8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.112995 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:49.120326 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918cfd9049a542fbb35c4b595dd2ded8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.128577 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1452/2873] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:29:49 2022] DELETE /identity/v3/users/918cfd9049a542fbb35c4b595dd2ded8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:49.132942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f026-ec01-4aa0-b090-3500509d38ab None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:49.133446 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f026-ec01-4aa0-b090-3500509d38ab None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:49.133560 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20f026-ec01-4aa0-b090-3500509d38ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:49.151731 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-2d20f026-ec01-4aa0-b090-3500509d38ab None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:29:49.152956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2d20f026-ec01-4aa0-b090-3500509d38ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:49.168071 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=100 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:29:49.223119 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1422/2874] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:29:49.236053 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:49.237495 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:49.312765 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988061f7-01ff-4ea2-b12f-d3c77f654ada admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:49.316512 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c3447-3507-4acc-8ded-5e36bda97ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:49.317231 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c3447-3507-4acc-8ded-5e36bda97ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:49.317521 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c3447-3507-4acc-8ded-5e36bda97ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:49.317797 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c3447-3507-4acc-8ded-5e36bda97ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:49.328317 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c3447-3507-4acc-8ded-5e36bda97ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:49.329749 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c3447-3507-4acc-8ded-5e36bda97ccd service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:49.340970 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1453/2875] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:49.529700 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20f026-ec01-4aa0-b090-3500509d38ab None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:49.531200 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-2d20f026-ec01-4aa0-b090-3500509d38ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:49.545221 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20f026-ec01-4aa0-b090-3500509d38ab None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:49.551206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:49.552210 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:49.552518 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:49.552791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] PATH_INFO: `/v3/projects/051558f24d7f41dba8eb52207f4fb84b` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:49.553982 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051558f24d7f41dba8eb52207f4fb84b)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:49.555971 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:49.614607 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051558f24d7f41dba8eb52207f4fb84b', 'request_id': 'req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.620870 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051558f24d7f41dba8eb52207f4fb84b', 'request_id': 'req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.628036 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051558f24d7f41dba8eb52207f4fb84b', 'request_id': 'req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.639009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] The token cache is being invalidate because project 051558f24d7f41dba8eb52207f4fb84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:29:49.639321 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.639993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-f8e0e956-bb7e-4cfe-b173-cb8194ae36e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:29:49.641547 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1423/2876] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:29:49 2022] DELETE /identity/v3/projects/051558f24d7f41dba8eb52207f4fb84b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:29:52.287197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c3447-3507-4acc-8ded-5e36bda97ccd service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:29:52.289390 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-139c3447-3507-4acc-8ded-5e36bda97ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:52.360003 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c3447-3507-4acc-8ded-5e36bda97ccd service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:29:52.419637 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:29:52.420288 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:29:52.420578 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:29:52.420852 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:29:52.422738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:29:52.434504 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:29:52.436106 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:29:52.445856 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1454/2877] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:29:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:29:59.636022 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:02.441630 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=87,keystone:DELETE=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:08.304606 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d679b-e239-4957-94ad-7d28dd9d7bd3 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:08.305132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d679b-e239-4957-94ad-7d28dd9d7bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:08.305132 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d679b-e239-4957-94ad-7d28dd9d7bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:08.324026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-686d679b-e239-4957-94ad-7d28dd9d7bd3 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:08.325272 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-686d679b-e239-4957-94ad-7d28dd9d7bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:08.384028 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1424/2878] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:30:08.402264 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:30:08.403857 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:08.476642 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d9a8d-bf01-43f3-9e52-10b2624aadcf service placement] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:30:08.482030 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e6627-aeef-445e-84b0-5f7143f46b16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:30:08.482678 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e6627-aeef-445e-84b0-5f7143f46b16 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:08.482961 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e6627-aeef-445e-84b0-5f7143f46b16 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:08.483238 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e6627-aeef-445e-84b0-5f7143f46b16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:08.497526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e6627-aeef-445e-84b0-5f7143f46b16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:30:08.499505 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e6627-aeef-445e-84b0-5f7143f46b16 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:30:08.510143 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1455/2879] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 07 14:30:11.367619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee066d-c68a-4d1a-8f97-331a0016a6b7 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:11.368126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee066d-c68a-4d1a-8f97-331a0016a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:11.368126 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee066d-c68a-4d1a-8f97-331a0016a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:11.386157 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-dfee066d-c68a-4d1a-8f97-331a0016a6b7 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:11.387378 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-dfee066d-c68a-4d1a-8f97-331a0016a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:11.395133 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1425/2880] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:30:11.418562 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e6627-aeef-445e-84b0-5f7143f46b16 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:30:11.420001 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bd3e6627-aeef-445e-84b0-5f7143f46b16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:11.435417 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e6627-aeef-445e-84b0-5f7143f46b16 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:30:11.441014 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c614e-b63d-4798-b80b-c9c22630f1c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:30:11.441647 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c614e-b63d-4798-b80b-c9c22630f1c1 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:11.441934 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c614e-b63d-4798-b80b-c9c22630f1c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:11.442215 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c614e-b63d-4798-b80b-c9c22630f1c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:11.450400 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c614e-b63d-4798-b80b-c9c22630f1c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:30:11.452011 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c614e-b63d-4798-b80b-c9c22630f1c1 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:30:11.461492 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1456/2881] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:30:14.590256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebb8a3-a1f6-478e-a818-3a02181f5fa2 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:14.590775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebb8a3-a1f6-478e-a818-3a02181f5fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:14.590775 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebb8a3-a1f6-478e-a818-3a02181f5fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:14.609146 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-75ebb8a3-a1f6-478e-a818-3a02181f5fa2 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:14.610345 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-75ebb8a3-a1f6-478e-a818-3a02181f5fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:14.618914 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1426/2882] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:30:14.632984 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c614e-b63d-4798-b80b-c9c22630f1c1 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:30:14.644237 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c614e-b63d-4798-b80b-c9c22630f1c1 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:30:14.650227 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259a085-2f77-46d9-9a5a-addbd7176e08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:30:14.650849 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259a085-2f77-46d9-9a5a-addbd7176e08 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:14.651141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259a085-2f77-46d9-9a5a-addbd7176e08 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:14.651448 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259a085-2f77-46d9-9a5a-addbd7176e08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:14.659752 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259a085-2f77-46d9-9a5a-addbd7176e08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:30:14.661300 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259a085-2f77-46d9-9a5a-addbd7176e08 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:30:14.671487 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1457/2883] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:30:17.672271 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201730dc-e555-4e09-ab8c-f5646708cd4d None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:17.672739 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201730dc-e555-4e09-ab8c-f5646708cd4d None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:17.672853 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201730dc-e555-4e09-ab8c-f5646708cd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:17.690725 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-201730dc-e555-4e09-ab8c-f5646708cd4d None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:17.691954 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-201730dc-e555-4e09-ab8c-f5646708cd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:17.699942 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1427/2884] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:30:17.716914 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259a085-2f77-46d9-9a5a-addbd7176e08 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:30:17.729473 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259a085-2f77-46d9-9a5a-addbd7176e08 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:30:17.735151 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db155c9-145f-4fbf-85d3-49a7a309e4ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:30:17.735828 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db155c9-145f-4fbf-85d3-49a7a309e4ea service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:17.736116 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db155c9-145f-4fbf-85d3-49a7a309e4ea service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:17.736392 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db155c9-145f-4fbf-85d3-49a7a309e4ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:17.744754 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db155c9-145f-4fbf-85d3-49a7a309e4ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:30:17.746360 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db155c9-145f-4fbf-85d3-49a7a309e4ea service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:30:17.755881 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1458/2885] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:30:20.830341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4955454-decc-48a9-97cb-ffd1aec22616 None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:20.830868 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4955454-decc-48a9-97cb-ffd1aec22616 None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:20.831030 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4955454-decc-48a9-97cb-ffd1aec22616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:20.849448 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-f4955454-decc-48a9-97cb-ffd1aec22616 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:20.851240 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-f4955454-decc-48a9-97cb-ffd1aec22616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:20.859208 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1428/2886] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:30:20.876272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db155c9-145f-4fbf-85d3-49a7a309e4ea service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:30:20.887978 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db155c9-145f-4fbf-85d3-49a7a309e4ea service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:30:20.893540 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea933-b05a-4d18-bb2a-6c03bbdad2c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:30:20.894182 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea933-b05a-4d18-bb2a-6c03bbdad2c6 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:20.894465 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea933-b05a-4d18-bb2a-6c03bbdad2c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:20.894740 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea933-b05a-4d18-bb2a-6c03bbdad2c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:20.903561 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aea933-b05a-4d18-bb2a-6c03bbdad2c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:30:20.905128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aea933-b05a-4d18-bb2a-6c03bbdad2c6 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:30:20.915871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1459/2887] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:30:23.984673 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b0ba9-94d7-4a29-93fe-9d5635958c4c None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:23.985138 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b0ba9-94d7-4a29-93fe-9d5635958c4c None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:23.985277 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b0ba9-94d7-4a29-93fe-9d5635958c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:24.004260 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-218b0ba9-94d7-4a29-93fe-9d5635958c4c None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:24.005445 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-218b0ba9-94d7-4a29-93fe-9d5635958c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:24.013864 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1429/2888] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:30:24.031701 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea933-b05a-4d18-bb2a-6c03bbdad2c6 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:30:24.043257 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea933-b05a-4d18-bb2a-6c03bbdad2c6 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:30:24.048738 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c3848-79f2-441d-9221-e07b826e9469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:30:24.049418 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c3848-79f2-441d-9221-e07b826e9469 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:24.049700 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c3848-79f2-441d-9221-e07b826e9469 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:24.049976 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c3848-79f2-441d-9221-e07b826e9469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:24.058242 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c3848-79f2-441d-9221-e07b826e9469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:30:24.059823 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c3848-79f2-441d-9221-e07b826e9469 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:30:24.069524 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1460/2889] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:30:33.999117 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=42 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:34.064918 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=64 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:39.057791 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f080d-f094-4924-af42-1f98f5f8382a None None] REQUEST_METHOD: `POST` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:39.058305 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f080d-f094-4924-af42-1f98f5f8382a None None] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:39.058416 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f080d-f094-4924-af42-1f98f5f8382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:39.076486 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.auth.core [None req-e18f080d-f094-4924-af42-1f98f5f8382a None None] MFA Rules not processed for user `c9d6fb446bed4ac9b756245e2ae2189e`. Rule list: `[]` (Enabled: `True`). {{(pid=80292) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:39.077697 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-e18f080d-f094-4924-af42-1f98f5f8382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:39.131701 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1430/2890] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jun 7 14:30:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:30:49.124940 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=25 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:30:51.862750 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643017-3eb6-49b1-8090-ce7bc6c9b152 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:51.863309 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643017-3eb6-49b1-8090-ce7bc6c9b152 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:51.863309 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19643017-3eb6-49b1-8090-ce7bc6c9b152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:51.882575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-19643017-3eb6-49b1-8090-ce7bc6c9b152 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:51.883809 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-19643017-3eb6-49b1-8090-ce7bc6c9b152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:51.891705 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1461/2891] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:30:51.941467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f080d-f094-4924-af42-1f98f5f8382a None None] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:30:51.954722 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f080d-f094-4924-af42-1f98f5f8382a None None] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:30:51.960434 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a923e-0fcf-49c8-a7e9-0132ae105409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:30:51.961225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a923e-0fcf-49c8-a7e9-0132ae105409 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:51.961513 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a923e-0fcf-49c8-a7e9-0132ae105409 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:51.961793 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a923e-0fcf-49c8-a7e9-0132ae105409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:51.970231 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a923e-0fcf-49c8-a7e9-0132ae105409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:30:51.971815 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a923e-0fcf-49c8-a7e9-0132ae105409 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:30:51.982474 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1431/2892] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:30:55.112784 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d077f-7633-4135-baee-c2f7ab8c1529 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:55.113343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d077f-7633-4135-baee-c2f7ab8c1529 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:55.113343 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d077f-7633-4135-baee-c2f7ab8c1529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:55.133279 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e39d077f-7633-4135-baee-c2f7ab8c1529 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:55.134475 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e39d077f-7633-4135-baee-c2f7ab8c1529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:55.142240 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1462/2893] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:30:55.174254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a923e-0fcf-49c8-a7e9-0132ae105409 service nova] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:30:55.185902 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a923e-0fcf-49c8-a7e9-0132ae105409 service nova] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:30:55.191316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2b54b-e73f-4c6c-90de-779991721a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:30:55.191981 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b54b-e73f-4c6c-90de-779991721a65 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:55.192293 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b54b-e73f-4c6c-90de-779991721a65 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:55.192574 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2b54b-e73f-4c6c-90de-779991721a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:55.201316 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2b54b-e73f-4c6c-90de-779991721a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:30:55.202892 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2b54b-e73f-4c6c-90de-779991721a65 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:30:55.212890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1432/2894] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:30:58.175004 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b8ce8-c6fd-4237-b808-ed8d502021fa None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:58.175574 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b8ce8-c6fd-4237-b808-ed8d502021fa None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:58.175683 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b8ce8-c6fd-4237-b808-ed8d502021fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:58.193979 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ab9b8ce8-c6fd-4237-b808-ed8d502021fa None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:30:58.195158 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ab9b8ce8-c6fd-4237-b808-ed8d502021fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:30:58.202779 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1463/2895] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:30:58.243414 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2b54b-e73f-4c6c-90de-779991721a65 service nova] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:30:58.254583 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2b54b-e73f-4c6c-90de-779991721a65 service nova] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:30:58.260216 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e433c-4391-417a-97e7-1fe902c3f7e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:30:58.260857 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e433c-4391-417a-97e7-1fe902c3f7e5 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:30:58.261134 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e433c-4391-417a-97e7-1fe902c3f7e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:30:58.261409 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e433c-4391-417a-97e7-1fe902c3f7e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:30:58.269632 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e433c-4391-417a-97e7-1fe902c3f7e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:30:58.271187 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e433c-4391-417a-97e7-1fe902c3f7e5 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:30:58.280484 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1433/2896] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:00.504315 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b8ce8-c6fd-4237-b808-ed8d502021fa None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:00.505763 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ab9b8ce8-c6fd-4237-b808-ed8d502021fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:00.565812 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b8ce8-c6fd-4237-b808-ed8d502021fa None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:00.570016 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c85983-861f-404d-955d-779e463e334b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:00.570669 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c85983-861f-404d-955d-779e463e334b service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:00.570991 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c85983-861f-404d-955d-779e463e334b service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:00.571272 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c85983-861f-404d-955d-779e463e334b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:00.573112 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-01c85983-861f-404d-955d-779e463e334b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:00.583137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c85983-861f-404d-955d-779e463e334b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:00.584603 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c85983-861f-404d-955d-779e463e334b service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:00.592789 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1464/2897] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:00.685049 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e433c-4391-417a-97e7-1fe902c3f7e5 service nova] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:00.694449 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e433c-4391-417a-97e7-1fe902c3f7e5 service nova] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:00.697976 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5529-0fca-482f-95b3-340a05bcf159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:00.698619 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5529-0fca-482f-95b3-340a05bcf159 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:00.698904 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5529-0fca-482f-95b3-340a05bcf159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:00.699183 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b5529-0fca-482f-95b3-340a05bcf159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:00.700997 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-147b5529-0fca-482f-95b3-340a05bcf159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:00.714570 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b5529-0fca-482f-95b3-340a05bcf159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:00.716025 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b5529-0fca-482f-95b3-340a05bcf159 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:00.726915 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1434/2898] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:01.310878 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbdcf4-e8a4-4ee7-82a3-7af719f26371 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:01.311167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbdcf4-e8a4-4ee7-82a3-7af719f26371 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:01.311490 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbdcf4-e8a4-4ee7-82a3-7af719f26371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:01.329643 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3ffbdcf4-e8a4-4ee7-82a3-7af719f26371 None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:01.330957 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3ffbdcf4-e8a4-4ee7-82a3-7af719f26371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:01.338712 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1465/2899] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 07 14:31:01.354703 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5529-0fca-482f-95b3-340a05bcf159 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:01.365956 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b5529-0fca-482f-95b3-340a05bcf159 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:01.373137 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8c51-8f5e-4608-8bf9-42256c0b6dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:01.373787 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8c51-8f5e-4608-8bf9-42256c0b6dc4 service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:01.374075 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8c51-8f5e-4608-8bf9-42256c0b6dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:01.374358 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8c51-8f5e-4608-8bf9-42256c0b6dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:01.383256 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf8c51-8f5e-4608-8bf9-42256c0b6dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:01.385047 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf8c51-8f5e-4608-8bf9-42256c0b6dc4 service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:01.395224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1435/2900] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:04.486803 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf94a-c71d-482d-b653-58caa4f5ea3c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:04.487380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf94a-c71d-482d-b653-58caa4f5ea3c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:04.487380 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf94a-c71d-482d-b653-58caa4f5ea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:04.507128 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f02cf94a-c71d-482d-b653-58caa4f5ea3c None None] MFA Rules not processed for user `6dac917bcc034de386b578ee9ad980f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 07 14:31:04.508954 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f02cf94a-c71d-482d-b653-58caa4f5ea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:04.517043 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1466/2901] 10.222.0.72 () {58 vars in 1016 bytes} [Tue Jun 7 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 07 14:31:04.545993 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8c51-8f5e-4608-8bf9-42256c0b6dc4 service nova] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:04.557767 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8c51-8f5e-4608-8bf9-42256c0b6dc4 service nova] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:04.563225 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427df6e-51c2-4f6c-a254-c90a00ab7e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:04.563890 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427df6e-51c2-4f6c-a254-c90a00ab7e8c service nova] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:04.564178 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427df6e-51c2-4f6c-a254-c90a00ab7e8c service nova] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:04.564456 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427df6e-51c2-4f6c-a254-c90a00ab7e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:04.573079 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427df6e-51c2-4f6c-a254-c90a00ab7e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:04.574643 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427df6e-51c2-4f6c-a254-c90a00ab7e8c service nova] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:04.584013 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1436/2902] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:14.012537 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf94a-c71d-482d-b653-58caa4f5ea3c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:14.025733 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf94a-c71d-482d-b653-58caa4f5ea3c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:14.032494 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a76b7-3e45-4964-a697-a5ceb4e11892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1ea02cd5e644aaba236acf4e46cb20f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:14.033152 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a76b7-3e45-4964-a697-a5ceb4e11892 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:14.033491 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a76b7-3e45-4964-a697-a5ceb4e11892 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:14.033776 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a76b7-3e45-4964-a697-a5ceb4e11892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:14.035746 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6a8a76b7-3e45-4964-a697-a5ceb4e11892 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:14.048195 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a76b7-3e45-4964-a697-a5ceb4e11892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:14.049783 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a76b7-3e45-4964-a697-a5ceb4e11892 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:14.060575 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1467/2903] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:31:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:31:14.579746 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=36 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:24.056079 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=47 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:33.563259 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427df6e-51c2-4f6c-a254-c90a00ab7e8c service nova] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:33.564856 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-3427df6e-51c2-4f6c-a254-c90a00ab7e8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:31:33.578973 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427df6e-51c2-4f6c-a254-c90a00ab7e8c service nova] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:33.583817 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:33.584729 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:33.585011 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:33.585288 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] PATH_INFO: `/v3/users/c9d6fb446bed4ac9b756245e2ae2189e` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:33.586671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d6fb446bed4ac9b756245e2ae2189e)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:33.589289 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:33.636672 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d6fb446bed4ac9b756245e2ae2189e'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:33.637326 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d6fb446bed4ac9b756245e2ae2189e'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:33.644575 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d6fb446bed4ac9b756245e2ae2189e'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:33.645206 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d6fb446bed4ac9b756245e2ae2189e'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:33.652249 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d6fb446bed4ac9b756245e2ae2189e'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:33.669043 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1437/2904] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:31:33 2022] DELETE /identity/v3/users/c9d6fb446bed4ac9b756245e2ae2189e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:31:33.839685 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a76b7-3e45-4964-a697-a5ceb4e11892 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:31:33.850956 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a76b7-3e45-4964-a697-a5ceb4e11892 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:31:34.042334 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:31:34.043141 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:31:34.043460 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:31:34.043736 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] PATH_INFO: `/v3/projects/27e7df0e7d8748d793e50140ec5d7137` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:31:34.044930 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e7df0e7d8748d793e50140ec5d7137)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:31:34.046871 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:31:34.091886 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e7df0e7d8748d793e50140ec5d7137', 'request_id': 'req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:34.098788 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e7df0e7d8748d793e50140ec5d7137', 'request_id': 'req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:34.105017 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e7df0e7d8748d793e50140ec5d7137', 'request_id': 'req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:34.115690 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] The token cache is being invalidate because project 27e7df0e7d8748d793e50140ec5d7137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:31:34.115973 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:34.116587 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:31:34.118118 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1468/2905] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:31:33 2022] DELETE /identity/v3/projects/27e7df0e7d8748d793e50140ec5d7137 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:31:43.665463 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:31:44.112890 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:29.950197 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:29.952541 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:30.023500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96cd02-02ab-453f-b602-645adede6949 admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:30.059644 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:30.062031 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:30.081026 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:30.081984 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:30.082123 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:30.082403 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:30.085536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:30.098788 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:30.100283 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:30.109805 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1438/2906] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:30.128703 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a4403-aa9e-4f9f-8f37-958a0d12bdb2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:30.133767 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:30.134167 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:30.134454 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:30.134734 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:30.136572 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:30.208623 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:30.210137 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:30.221901 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1469/2907] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:31.453396 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:31.454797 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:31.465733 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864caf2-21ea-4661-918e-5e6636320730 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:31.469349 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34779e-de61-41c5-82f7-a1528909ba44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fafd295a115c4f5d912e49d6a21d67b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:31.469990 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34779e-de61-41c5-82f7-a1528909ba44 service neutron] REQUEST_METHOD: `GET` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:31.470275 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34779e-de61-41c5-82f7-a1528909ba44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:31.470553 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34779e-de61-41c5-82f7-a1528909ba44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:31.472351 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-cc34779e-de61-41c5-82f7-a1528909ba44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:31.486899 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34779e-de61-41c5-82f7-a1528909ba44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:31.488363 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34779e-de61-41c5-82f7-a1528909ba44 service neutron] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:31.499932 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1439/2908] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:32:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:32:39.941144 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:39.942794 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:40.016508 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4e446-4f30-4888-98b0-d1d97c162331 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:40.020911 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:40.021774 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:40.022051 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:40.022323 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] PATH_INFO: `/v3/users/d26187d738fa44bdac86d335433b5002` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:40.023533 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26187d738fa44bdac86d335433b5002)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:40.026005 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:40.068092 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:40.070650 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26187d738fa44bdac86d335433b5002'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.079249 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26187d738fa44bdac86d335433b5002'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.079935 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26187d738fa44bdac86d335433b5002'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.087546 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26187d738fa44bdac86d335433b5002'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.099197 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26187d738fa44bdac86d335433b5002'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.105045 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1470/2909] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:32:39 2022] DELETE /identity/v3/users/d26187d738fa44bdac86d335433b5002 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:32:40.275063 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34779e-de61-41c5-82f7-a1528909ba44 service neutron] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:40.286957 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34779e-de61-41c5-82f7-a1528909ba44 service neutron] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:40.344341 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:40.345213 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:40.345614 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:40.345897 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] PATH_INFO: `/v3/projects/95db574ff7d942149631c0f9a89228a3` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:40.347078 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=95db574ff7d942149631c0f9a89228a3)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:40.349148 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:40.393032 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:40.394224 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95db574ff7d942149631c0f9a89228a3', 'request_id': 'req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.401059 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95db574ff7d942149631c0f9a89228a3', 'request_id': 'req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.408100 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95db574ff7d942149631c0f9a89228a3', 'request_id': 'req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.418441 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] The token cache is being invalidate because project 95db574ff7d942149631c0f9a89228a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:32:40.418730 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.419467 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.421009 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1440/2910] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:32:40 2022] DELETE /identity/v3/projects/95db574ff7d942149631c0f9a89228a3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:32:40.425199 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:40.426909 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:40.440559 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0e3bd-e8b2-42cc-8439-18c7ae915fc7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:40.496892 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:40.497800 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:40.498084 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:40.498362 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] PATH_INFO: `/v3/users/c53926ad18434a1c87dc2fe350586059` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:40.499594 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53926ad18434a1c87dc2fe350586059)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:40.501542 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:40.547222 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53926ad18434a1c87dc2fe350586059'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.554134 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53926ad18434a1c87dc2fe350586059'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.554805 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53926ad18434a1c87dc2fe350586059'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.562538 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53926ad18434a1c87dc2fe350586059'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.575169 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53926ad18434a1c87dc2fe350586059'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.581044 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1471/2911] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jun 7 14:32:40 2022] DELETE /identity/v3/users/c53926ad18434a1c87dc2fe350586059 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:32:40.753735 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] Authenticating user token {{(pid=80292) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:32:40.755169 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.fernet_utils [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80292) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:32:40.768581 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb5ab2-1296-4de5-af25-1b1a69b0da1e admin admin] Validating token access rules against request {{(pid=80292) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:32:40.826536 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dac917bcc034de386b578ee9ad980f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a7d532589ce43f88947a3878f92cba0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80292) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:32:40.827361 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:32:40.827671 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:32:40.827953 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] PATH_INFO: `/v3/projects/0bcf025d700a4bc9ba3c95dcd881977f` {{(pid=80292) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:32:40.829172 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcf025d700a4bc9ba3c95dcd881977f)` {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:32:40.831068 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] RBAC: Authorization granted {{(pid=80292) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:32:40.877053 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcf025d700a4bc9ba3c95dcd881977f', 'request_id': 'req-90afc11e-a507-401f-a47a-4603c360c5be'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.883254 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcf025d700a4bc9ba3c95dcd881977f', 'request_id': 'req-90afc11e-a507-401f-a47a-4603c360c5be'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.890292 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcf025d700a4bc9ba3c95dcd881977f', 'request_id': 'req-90afc11e-a507-401f-a47a-4603c360c5be'} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.900500 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] The token cache is being invalidate because project 0bcf025d700a4bc9ba3c95dcd881977f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80292) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 07 14:32:40.900783 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.901427 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG keystone.notifications [None req-90afc11e-a507-401f-a47a-4603c360c5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80292) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 07 14:32:40.903002 dv-cinder-836083-9-smb devstack@keystone.service[80292]: [pid: 80292|app: 0|req: 1441/2912] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jun 7 14:32:40 2022] DELETE /identity/v3/projects/0bcf025d700a4bc9ba3c95dcd881977f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 07 14:32:50.577569 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:32:50.897421 dv-cinder-836083-9-smb devstack@keystone.service[80292]: DEBUG dbcounter [-] [80292] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 14:34:58.072802 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 07 14:34:58.074283 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:58.215418 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f9379-436b-4fcb-bc08-bde1098f2c4b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 07 14:34:58.272321 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499318e-3dce-4f4d-9ec4-afaa8c356e0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cc577feba04e66b950a69b918d4ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3993f115eb5d49abac749d934f3ec449', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 07 14:34:58.272965 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499318e-3dce-4f4d-9ec4-afaa8c356e0a service placement] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 07 14:34:58.273250 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499318e-3dce-4f4d-9ec4-afaa8c356e0a service placement] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 07 14:34:58.273526 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499318e-3dce-4f4d-9ec4-afaa8c356e0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 07 14:34:58.275882 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2499318e-3dce-4f4d-9ec4-afaa8c356e0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 07 14:34:58.286747 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499318e-3dce-4f4d-9ec4-afaa8c356e0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 07 14:34:58.288351 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499318e-3dce-4f4d-9ec4-afaa8c356e0a service placement] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 07 14:34:58.298919 dv-cinder-836083-9-smb devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1472/2913] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jun 7 14:34:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 07 14:35:08.294462 dv-cinder-836083-9-smb devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}